It'd be interesting if this could be embedded in the client/server, e.g. Jitsi. At work we turn off cameras to save bandwidth, but this seems like you could just send a bitstring, and heavily compressed at that.

Actually that reminds me of - and i personally think it's the future of video compression - that there a neural network based codecs in the making https://developer.nvidia.com/ai-video-compression

Yeah would be fun if you could gzip/compress let's say 4 frames every 200ms and make your own ascii video stream codec so to speak