Now, I think their viewpoints are disgusting too. But their views don't affect people, their actions do.
I can't, for the life of me, understand how you can't find evidence (example of Alt-right figurehead Milo Yiannopoulos):
http://abcnews.go.com/Entertainment/leslie-jones-twitter-tro...
Now, whether he should be banned for what he did is up for contention. But he knows what he did, and he knows how he attacked her.