(Here)We can't be forced into the same community, we can be walled off from it, though.

You chose what to read, from the titles you choose which posts interest you, of those you choose which to comment, and vote, you have been forced to do nothing, but pass on titles that repel you.
If those titles get to be too much you can mute their authors.

But, by creating groups you build walls to keep out ideas that don't agree with your confirmation bias.
This is exactly what led to those folks being bombed out of their good thing, and into your difficult situation.

Those of us that have read history are doomed to watching those who haven't repeat the mistakes of yesterday.