Get rid of tummy fat? Slender build?

I have always been a very thin person and had trouble gaining weight. I am currently 5 foot 7 and weigh about 125. I am heavier now than I have ever been and don't mind my weight, I am actually happy that I have some curves now. What is REALLY bothering me is that now I have a 'baby bump' I swear I look 5 months pregnant, this really makes me self concious because I have always been very slender. I hate it and have tried tummy control pantyhose, camisoles and anything else I can find but since my overall size is small none of these garments are tight enuff to help. This tummy really bothers me, I don't want to diet because I do not want to lose thebeneficial weight I have gained....how can I get rid of this belly?