Because people will be deeply affected by this, and not in the positive way. We already had this with copilot: https://i.imgur.com/nguIAsv.jpeg

Just as with copilot, this combines LLM's inability to repeatably do math correctly with peoples' overassurance in LLM's capabilities.