To clarify on the “learn and improve” part, I mean I get it in the context of a human doing it. When a person learns, that lesson sticks so errors and retries are valuable.

For LLMs none of it sticks. You keep “teaching” it and the next time it forgets everything.

So again you keep trying until you get the results you want, which you need to know ahead of time.