As I understand it, these models respond at the same sort of level as the prompts; writing like you're a kid, get a simple reply, write like a PhD and get a fancy one.
"Autocomplete on steroids" has always felt to me like it needlessly diminished how good it is, but in this aspect I'd say it's an important and relevant part of the behaviour.
The issue I am talking about is not about prompting, but a limitation of the models and algorithms below this layer. Prompting only exists because of the chat fine-tuning that happened at the later stages
"Autocomplete on steroids" has always felt to me like it needlessly diminished how good it is, but in this aspect I'd say it's an important and relevant part of the behaviour.