It makes sense that less visitors means less comments voted. That's a good opportunity to get out and about - something I've not been that good at doing recently (these posts don't help!)

It would be interesting to hear about the results of your experiment. The best result would be to snag a few new followers by commentating/voting elsewhere I guess. Good luck!