The other thing is that it's logically similar to "You'll wish you'd spent more of your time on your yacht than the office."

Some of us have to work to afford time with family and friends, or even to afford family and friends at all.