Then I write it myself or tell it to correct itself. They tend to be confidently incorrect in many cases, but especially with the online ones you can tell them that "this bit is bullshit" and they'll try again with a different lib.

Works for common stuff, not so much for highly specialised things. An LLM can't know something it hasn't been "taught".