People do not understand that free speech only applies to governments, because governments are supposed to have a monopoly on violence. Violence between citizens is illegal, however violence by the government onto the citizens is perfectly legal. The government has all the right to force you to go to prison against your will with a lot of allowed means.
There's (mostly) no such thing between citizens. There's stuff like self-defense but that's pretty much it. So free speech is necessary as a governmental concept since otherwise citizens may feel the full force of the government's wrath just for saying something the government doesn't agree with.
But between citizens, theoretically if everyone adheres to all laws, there's nothing really bad that one citizen can do to another. Yeah you might be shunned socially, which definitely can be incredibly bad, but it's more easily manageable than being shot or put into a dark cell for the rest of your life.
So the "free speech" concept is not really something people should try to apply to their lives except when dealing with the government. If someone says some nasty shit, everyone else is free to start ignoring them or not letting them come into their spaces. That's how it should be, it's not even remotely desirable to let them continue spouting their nasty shit without consequences.