Roman elites spoke a lot of Greek among themselves, a bit similar to how Tsarist nobility used French

Sure, I mean obviously he knew Greek, but I'd never heard anyone assert that his last words were in Greek!