Yeah you would need to leave the browser window open at least in the background for this to work. Just to be clear this doesn't automatically vote for you, it just opens the post ready to vote if you like it :)