I think you're legitimately concerned, but I think your concerns are about as well grounded in reality as that of most conspiracy theorists. What proof (not tweets or opinion pieces) do you have to support your claim? "There are a lot of black people therefore any adverse action to the region is because of racism" is not proof. California's demographic makeup isn't predominantly white. Why are they a state?
You're right: not everything is racially motivated. Except for the things that so plainly and obviously are.
Also: please do not implicitly label my concern as being not legitimate. I'm not really that into clumsy gaslighting.