Maybe they could even encourage people to participate with a "bounty", of sorts. If your downvote triggers a delegation removal, then you'll get an equivalent delegation for a period of N days.