You aren't going to spend 12 hours a day, 6 days a week working in your garden. When you get hot and tired, you'll stop. I think that is the more relevant difference in this particular topic.
Growing up on a small farm, I can assure you that people do work 12 hour days for multiple days on end in their fields. You can’t always stop even when you’re tired; farm animals break out, rain will destroy cut hay, etc.
It’s a hard job, and not one that tends to pay well.
If I spend my Saturday toiling for wages digging with my hands, sweating for hours, just please some land owner I feel exploited.
It is not the work or the hours that is the core problem.