Polymaths in particular could be good or great at many things. It’s a matter of choice and opportunity. But they can’t be great at absolutely everything. So one choice closes another. And the grass is greener on the other side.
Particularly if a school of knowledge is at all dangerous. To the body or the mind. For instance trying to cure an infectious disease, which is both every time you fail.