Freedom means freedom of association. This means also that people must be free to disassociate themselves from others, whether their reason for this separation is rational or not.

I can be tolerant of idiots who don't use coercion to back their idiotic ideas. I probably won't choose to associate with them, though.

I can't be tolerant of puritanical, authoritarian busybody control freaks.