That's very true, and I believe Wayland has a DRM leasing extension just for this use case. SteamVR uses it to punch through the compositor and draw straight to the screen.