Why do you think so? Would it not be better to recognize fascism/nazism as early as possible? Hitler was in power for several years, doing various increasingly bad stuff, before he started the holocaust.
Nowadays this label is overused so much that it pretty much lost it's meaning. It's not fascism-nazism to be against mass migration. Nor it's fascism-nazism to not fully support whatever letter comes next to join LGBTQAZ+ or whatever it is now.
Just like it's not communism to advocate for better welfare, labor rights, affordable housing and so on.
