Unfortunately, losing your breast size is not uncommon--especially if you are losing lots of weight. About 7 years ago, I lost 50 pounds and went down from a 36C to a 32B. I didn't mind being smaller, but I HATED the shape of my breasts--they looked like pancakes for a while. About a year later, though, they firmed up.
This time around, I have less weight to lose but started out as a 36D for some reason. I've lost about 14 pounds and have gone down to a C. My back is happier, but I'm a bit nervous to how it's going to effect the shape again.
I read some advice from a pregnancy book ("Pregnancy Sucks" - a better book than the title suggests) that it may help to wear a really good supportive bra at night when your breasts shrink (after lactation)--so I'm planning to start trying that with this weight loss. I'm curious to see if stretch-mark creme helps, too.
If your breasts shrink and you miss being buxom, get some good push up bras (or the kinds with gels). They add some nice curves even for flat-chested girls (my size A sister LOVES them).