Okay. Respect your point of view. I am curious, what applications do you think SSMs enable that a Transformer cannot? I have always seen it as a drop-in replacement (like for like) but maybe there is more to it.
Personally, I think going linear instead of quadratic for a core operation that a system needs to do is by definition an optimization.
Personally, I think going linear instead of quadratic for a core operation that a system needs to do is by definition an optimization.