A calorie is a unit of energy - specifically the amount of energy it takes to heat one kilogram of water one degree centigrade. Think of your body as a large engine, an engine that pumps over a gallon of blood once a second, fires billions of neurons in your brain, contracts and expands your muscles, etc. Even if you don't do a lick of exercise, that engine still requires a lot of energy -- and that is your basal metabolic rate.
Thus your basal metabolic rate + the calories you expend in exercise - the calories you consume in food and drink = your energy surplus/deficit.