Achromatopsia affects one in ~33,000 people. By comparison, any form of colorblindness affects one in 8 men and one in 200 women.

I'm not sure "someone using this system might see everything as the same shade of grey" is a realistic concern at those levels of incidence.