Likewise when they use all these benchmarks for "intelligence" and the tool will do the silliest things that you'd consider unacceptable from a person once you've told them a few times not to do a certain thing.

I love the paradigm shift but hate when the hype is uninformed or dishonest or not treating it with an eye for quality.