~ "We tried a new optimization technique that modifies how next token candidates are chosen and there was a bug."
That would definitely produce the behavior people saw and makes sense.
~ "We tried a new optimization technique that modifies how next token candidates are chosen and there was a bug."
That would definitely produce the behavior people saw and makes sense.