Editing and deleting not only your messages but also the LLM's messages should be trivial.

One of the coolest things about LLM tech is that it's stateless, yet we leave that value on the floor when UIs act like it's not.

Press the 3-dots menu in the upper right of the panel, and then choose "New Text Thread" instead of "New Thread".