The open source code is at https://github.com/vb000/LookOnceToHear and the research paper is at https://arxiv.org/abs/2405.06289

So perhaps this is not as out of reach as many pop-science articles. I’d love to hear if anyone is able to get this working independently.