> There's no specific reason why LLMs couldn't be trained to say "Don't know" when they don't know.
Yes there is, it's that we don't know how. We don't have anywhere close to the level of understanding to know when an LLM knows something and when it doesn't.
Training on material that includes "I don't know" will not work. That's not the solution.
If we knew how, we'd be doing it, since that's the #1 user complaint, and the company that fixed it would win.
Yes there is, it's that we don't know how. We don't have anywhere close to the level of understanding to know when an LLM knows something and when it doesn't.
Training on material that includes "I don't know" will not work. That's not the solution.
If we knew how, we'd be doing it, since that's the #1 user complaint, and the company that fixed it would win.