One can still be objective about it and consider at the facts

Regardless of the subject’s “sanity” or what team they currently belong to

That sounds like part of the problem. Why should we even know the position of a justice on a topic like that? At best making opinions public just leads to recusing in some cases. At worst it leads to the kind of distrust in the judiciary we're experiencing now.