Sort:  

It would grow at the same pace as the voting power but would have the ability to deplete 10 times faster. (The first SP to go down when flagging.)

Also somehow if the system could factor in voter reputation while calculating payouts it will level out the field a little bit more.

That may work. I don't downvote but if that helps weed out spam and trolls and if that encourages people to make better content and stuff, then maybe we should try this.