Starlink lets me text remotely now (T-Mobile beta). OP's problem will disappear in a few years if that or similar constellations can be maintained. For better or for worse.
The Starlink terminal absolutely drinks power. Mechanical refrigeration and power to run a beefy machine for inference together use less. I know, I have a cabin and power all of this on solar.
Side note: It's much nicer if you have a small battery to act as a reservoir. The solar panel charges the battery and the battery charges everything else. That way you don't have to leave your phone out in the sun, and a moment's clouds won't cause your devices to stop charging.
Just do the math (between your daily estimated solar panel output and your device consumption)... try not to let the battery drain to under 20% or charge to over 80%.
Sounds like a fun experiment. That should be enough to keep your phone charged or maybe power a small laptop.
I like to use boost style charge controllers and run the panels in parallel boosting up to 48 volts (nominal.) This is optimal for sub 2kw arrays (otherwise you'll start needing impractically large conductors.)
Although with a set up that small it doesn't really matter.