There is. At least on iOS, your google drive files show up in the Files app as well as in the OS file picker. They are just as accessible as locally stored files.
Any app which can open files can open files stored on Google Drive. What apps can't do is open files the app did not create, without the users input, without getting a security audit. Which seems perfectly fine to me.
I think the main issue is it's just different to how it was before and Google won't be grandfathering in old apps. So you have to rebuild the integrations to use the new APIs which mostly let you do the same thing but it's still not a trivial drop in replacement.
There are a ton of options here that don’t involve unlimited access to all files.