Yes. It's a solved problem for Python with pyenv. Until you want to pin a particular version of Poetry.

It's also a solved problem for Ruby with rvm, node with nvm, java with the JDK_HOME env var, Maven with mvnvm, ...

Or it's a solved problem for most every tool, programming language or not, with asdf.