I find calves to be a genetic gift more than many other muscle parts. People also store fat in different areas, albiet the common areas like mid section, thighs etc are the major ones. You can find people with heavy torso's and stick arms, or vice versa.
As Mreik points out, your 2 main areas to work on are your diet and your exercise routine. Set your overall body goals (gain mass, lose weight, etc) and build a diet and routine around that. From there you will be able to start your progress.
You may see your calves as too large, but another view is your upper legs are a little small in comparison.
Work on an overall plan and it will help you bring everything into proportion.