This does seem like a big jump in performance from their previous model.

I'd really like to see comparisons vs GitHub Copilot and Googles Gemini equivalent, but these kinds of metrics are much more developer specific and I don't see them published often.

They're also only publishing deltas, so if GitHub did publish their equivalent metrics we still couldn't compare.

I'm a bit surprised I guess, because I always associated JetBrains with being more transparent.