Agreed the privacy that keeping AI "in a corner" appeals to me too.
The fundamental catch here is that 80%+ of the future benefit will likely come from the very thing that erodes privacy: deep integration and context. Imagine if a Gemini had your entire life in its context (haha scary I know!), prompting would be so much more powerful.
That's the core, uncomfortable trade-off we're all facing now.
It's not an uncomfortable tradeoff to me. These systems being deeply integrated is simply too high of a price to pay. I cannot imagine a future benefit so great that it would be worth that.
> Imagine if a Gemini had your entire life in its context (haha scary I know!)
Windows Recall [1] is this for your PC activities (not yet fed to AI, but I see no reason to think it will stay this way). Meta is working on glasses to record the IRL part. But your phone is probably enough for most of it. Joining Zoom meetings with AI note takers is getting popular [2]. Not long until in-person meetings will have AI listening in from the phone mics, of course just to increase productivity and to summarize and remind you later. Convenience!
If I can have the AI agent attend the meeting for me in the first place, and then provide me the notes that's the winning play. Take the morning stand-up: all the developers' agents know what they are working on and what any blockers are. They can all exchange information in a virtual AI meeting and then send the notes around. Meanwhile all the developers are getting something productive done.
The fundamental catch here is that 80%+ of the future benefit will likely come from the very thing that erodes privacy: deep integration and context. Imagine if a Gemini had your entire life in its context (haha scary I know!), prompting would be so much more powerful.
That's the core, uncomfortable trade-off we're all facing now.