I've heard various ideas such as limiting it only after mods have expended their points (this will require implementing a cooldown to prevent a user from getting points again too soon). I want to hear your feedback, and I'll roll together something for the next major update of the site. Leave your comments
I'd upvote this with the caveat that moderators be given more than the bare minimum of 5 points, on a regular basis. If and when this site becomes popular enough, there will be far too many shit posts that will need modded into oblivion, just as a matter of course, making it too easy to run out of points that other good posts would otherwise be deserving of.