I think we will, but I think at least for a while they'll be cloud-connected. And at the very least, they'll be battery-dependent. I wouldn't want to be unable to write well when my AI assistant runs out of juice for the day.
I'd be surprised if we have solar-powered AI assistants in my lifetime, in the way that we have solar-powered calculators.
Just saying, Guanaco LLama model just got released that actually beats GPT-3.5 in a fair few metrics. So right now it's already possible to run a local version with a beefy GPU and it'll only get better as time goes on.
In a strange coincidence I've recently been doing some tests with small 10 W solar panels and with two or three of those plus an Nvidia Xavier (20 W TDP) one could actually run a solar powered LLM right now with only about as much solar as fits on a person's back (though only the smaller 13B versions).
Give it a few years and we'll have them integrated into smartphones. So yes, you will in fact always have an LLM in your pocket just like the ol' calculator excuse.
That I doubt, but then again we've come ridiculously far in the last 20 years and having AI assistants will only accelerate research further. If the singularity is really just 6 years out as some calculate, then anything and everything is possible afterwards. If you believe such things of course.
But who, these days, can write much without power-dependent devices? I still use a notebook but within days I have little ability to parse my handwriting, and I rarely transfer anything handwritten to device.
True, I have disgraphia, which runs in my family. But my sense is that many young people barely did any handwriting in the last few years so I’m guessing handwriting is still less likely to be employed during power outages than just putting off writing.
I'd be surprised if we have solar-powered AI assistants in my lifetime, in the way that we have solar-powered calculators.