As far as I know, the flagging and the downvoting are the same.
I have also noticed random downvotes, but mostly from accounts with low amount of Steem Power, for example around 15 Steem Power. These accounts mostly do nothing, only downvoting posts.