When I was at my heaviest, nobody would believe me when I told them what my weight was. I was in the 'morbidly' obese category, with a BMI that was off the charts (60+). I was wearing UK size 34+, yet even my doctor wouldn't believe me when I told him my weight until he had actually put me on the scales. Now that I have lost weight, people still vastly underestimate my actual weight. I work in a charity shop, and on a regular basis I have people holding out clothes to me saying " This would look nice on you, and you'd fit into it easily." The clothes they show me are sizes 14 - 16, I am actually wearing 22s in jeans and 24/26 in tops.
Looks mean nothing. I'm 5"11, and my weight is evenly distributed, so it shows less. I am 'big-boned', not in the sense of using it as an excuse either - I had my bone density measured, and my bones are extremely dense and heavy, at the top range of the charts for males, and off the charts for females (which I am). I have broad shoulders, large feet, a wide back....I am built like a brick outhouse, as my mother lovingly tells me.

So the way you look really doesn't mean much.
That said, BMI is really very inaccurate and outdated. It leaves out a lot of important things, like your shape, your build, bone density, amount of muscle etc. There are hardcore athletes who, going strictly by BMI, would fall into the obese category, simply because their muscles are heavy. So that's not really something very accurate.
As Loch said, don't let it get to you. Go to the point where you feel happy and healthy, and don't get too hung up on the names that are given to things. My doc told me that I would never manage to get into the 'normal' or 'recommended' range of BMI. If I did that, I would be about 30+ lbs underweight for my build and frame. I'm not bothered. As long as I'm healthy and feel ok within myself, I don't care whether this silly scale calls me overweight, obese, or a one eyed ogre.
