AI; in commonly used forms, simply can't be trusted in a lot of critical situations.

It defeats the deterministic nature of computation. The answer might be right or it could be very wrong. Without some method of verification, you really don't know for sure anything more than you started with.

There are applications where some significant percentage of wrong answers can be tolerated. But I suspect these are fewer in number than those that can't.