Carbs are as bad as you want them to be, I personally like the spanking.
Like Steve said, it all comes down to losing weight means calories in < calories out.
Granted some people might be insulin resistant and this come with eating a lot of refined carbs, white bread, sugars, high fructose corn syrup. Whole grain breads slow the absorption of sugars because of the protein and fiber they also contain. It's not a huge improvement but worth looking into if weight loss is your goal.
If you absolutely cannot stand ANY whole grain breads, then yes you could cut it out of your diet, no one can stop you. Carbs are, however, a very important macronutrient and you should be focusing on getting them from fruits and vegetables. If you can stand oatmeal then try eating more of that (the old fashioned kind, not the instant packets) as it has some plant nutrients not readily found in other plants, and it's a grain that is low in gluten if you're sensitive to that.
The thing is with these low carb diets, is that no matter how you slice it, it's a low calorie diet. The public misconception is that bread is horrible and you should avoid it. Eating the right kinds in the right way and falling within your proper calorie level is what will help you the most. Low carb diets deplete the glycogen(energy) stores in your muscles which can give the impression of quick weight loss. This is why the scale can mislead you, and one of the reasons your weight fluctuates on a daily basis.
If you list a average day for your diet, what are you eating? We may be able to help you with where bread should fit into that, or any other short comings.