I assume that you, like myself, would be coming to the table with prior programing/technical experience. Someone very green would probably have to look things up all the time... I know I did. Also, where do you get the Python interpreter, or the C# or Swift compilers without the internet? I assume this $200 computer is windows, which comes with none of those. Maybe start with JS?
I agree with you, if you know your domain, you can probably do it (with headaches). If you don't, it's very hard or functionally impossible.
All those things can be downloaded from places with free WiFi. Stop in a McDonald's, Starbucks, or library, and download all the compilers and documentation you think you might need for the day or week or month or whatever. I am assuming you're in a part of the world where free WiFi is available somewhere, or a friend you can ask to get something for you (like I did when I was a kid and didn't have internet).
And even without compilers and interpreters, all you REALLY need is a text editor. Or pen and paper, in order to write code. Granted, it helps to verify the code works with compilers and interpreters, but it's possible to step through it manually yourself to verify its accuracy.
It's not too uncommon for me to write a chunk of code in a simple text editor, and then test and fix it up later.
If you're just getting started, download some technical books (you can find free ones online) or some step-by-step tutorials and work through them.
I actually got started programming in classrooms on my calculator, or in Q-Basic/HTML in the days of modems where I had to get permission to dial in to the internet, and everything went so slow I had to know exactly what I was going to get ahead of time, so I often went a long time before finding help online (which was pretty hard to find back then anyway).
I still managed to learn quite a bit. It's definitely possible. Not necessarily a perfect environment for coding, and definitely not ideal for a company that pressures you to perform at peak efficiency, but definitely possible.
I agree with you, if you know your domain, you can probably do it (with headaches). If you don't, it's very hard or functionally impossible.