Whats the issue? Are you afraid of being swayed? Feels a bit like homophobia at times. Those being most vocal are likely trying to hide something about their own personality...
The common opposition to Nazis is bigger than freedom of speech. Freedom of speech is just the baseline talking point Nazis use to get you to listen to them. Not that you'll be swayed but disarmed.