I love the philosophy behind Gustafson's Law: the problem size increases in response to computational resources.
You get a simple computer, you can drop bombs more accurately. Then you make word processors. Then text based simulation aka games. Then turn books into digital format. Then whole online libraries, ecommerce, social media, cryptocurrency, and so on.
Seeing a LLM as purely language based might be missing the forest for the atoms.
You get a simple computer, you can drop bombs more accurately. Then you make word processors. Then text based simulation aka games. Then turn books into digital format. Then whole online libraries, ecommerce, social media, cryptocurrency, and so on.
Seeing a LLM as purely language based might be missing the forest for the atoms.