SERVES YOU RIGHT!

How many of you have come across these words told to you? Many? How many of you have come across these words told to you by every other person, every other time? well i fall into the latter category. i'll quote a few examples here,

Me: I got screwed by my manager over productivity
Friend: Serves you right.

Me: I got a C over here in my appraisal (showing the appraisal and waving hands hysterically)
Manager: Serves you right.

Me: Buddy, that girl stood me up!
Friend: Serves you right.

Me: Freddy, i'll just have a large of vodka and nothin else, i have a terrible feeling.
Freddy(the Barman) : Serves you right, for drinkin all that stuff yesterday.

Why can't a conversation go like this,

Me: I made love to the neighbor's wife
Neighbor: My wife?!
Me: No, the opposite one.
Neighbor: Serves you right.