I've experienced this with IO performance for huge files too. A while back I setup a caching service on a spare older Mac Mini first with Docker for macOS and when it couldn't keep up I installed Windows and it was slightly better but still crap. I threw Ubuntu on it and I was saturating the gigabit connection without breaking a sweat.

I'm also a Rails dev and I do all my dev work on an M1 mac and don't even have Docker installed, though I've heard it has improved a lot recently.