Nutrition is not simply calories or macronutrients. This goes back to a saying I HATE: food is fuel.
Food has such a large psychological connection to us all. We break bread with friends, have a drink with colleagues and celebrate eating cake around loved ones.
I believe if you want a certain body composition you should try as hard as you can to achieve it. But if you simply wish to be healthy and happy; food falls much more in the grey area.
This is where we get this attitude that we need to punish ourselves after indulging. Moderation is key of course. Otherwise you start falling into an unhealthy pattern of overindulgence and an extreme view on "burning off that cake". This leads to an endless need to lose those final 5lbs.
And what for? So I can not enjoy the best cake in LA by @matchboxkitchen no sir I'll take extra buttercream with that slice