When the tide goes out on the AI hype there’s going to be a lot of companies currently using expensive API calls for simple classification tasks that will be quietly revamped to use a simple CNN.

ML is a toolbox of methods. Not every problem needs a transformer.