The magic is GPT4. Basically show GPT4 the right context, which today you can use a good retriever model for (I'm sure they also fine-tuned it, probably on GPT4 generated data...), a little bit of good prompt engineering, and viola.