Essentially, it's like a (text only) replicant
https://en.wikipedia.org/wiki/Replicant
How to make AI perfectible, then?