I think if we're going to have Karma be a source of contention and drama, let's have it be a more interesting source of contention and drama.
Why not make it so that everyone clicking on the Karma button can see exactly how much Karma that particular post got, from whom, and any comments they made?
Since its original purpose seems to have been subverted, I'm sure it would be much more entertaining that way.