I would also add that one fundamental aspect of linear algebra (that no one ever taught me in a class) is that non-linear problems are almost never analytically solvable (e.g. e^x= y is easily solved through logarithms, but even solving xe^x=y requires Lambert’s W function iirc). Almost all interesting real world problems are non-linear to some extent, therefore, linear algebra is really the only tool we have to make progress on many difficult problems (e.g. through linear approximation and then applying techniques of linear algebra to solve the linear problem).
This is correct which is why the Implicit Value Theorem is heavily under appreciated by newcomers, since it is saying roughly that "Locally, calculus = linear algebra" meaning at a certain scale all equations is linear algebra.
FWIW I lead with this whenever I find myself teaching lin.agl. and I agree it's the most important point of context for students entering the subject (and presumably embarking on undergrad math).
Yeah, it’s funny how most of high school is spent focusing on the “exceptional” solvable cases of nonlinear equations (low degree polynomials, simple trig equations, exponentials) that one can come out with the skewed idea that solvability in nonlinear equations is more common than it actually is. While I understand that it’s important to build up a vocabulary of basic functions (along with confidence manipulating them) I think it is also important to temper expectations with the reality that nonlinear behaviors are so diverse and common that it is an a small miracle that we have somehow discovered enough examples of analytically solvable systems to enable us to understand a rich subset of behaviors!
One of my favorite perspectives on the difficulty of formulating a general theory of PDE in light of the difficulties posed by nonlinearities is Sergiu Klainerman’s “PDE as a unified subject” https://web.math.princeton.edu/~seri/homepage/papers/telaviv.... If I understand correctly, any general theory of PDE would have to incorporate all the subtle behaviors of nonlinear equations such as turbulence (which has thus far evaded a unified description). Indeed, ”solvable” nonlinear systems in physics are so special Wikipedia has a list of them https://en.m.wikipedia.org/wiki/Integrable_system. With this perspective, I’m tempted to say (in a non-precise manner) that solvable systems are the vanishingly small exception to the rule in a frighteningly deep sea of unsolvable equations.
