Spend some time reading about infertility at the start of the baby making process and I think you’ll find that it can terribly difficult. Especially as you progress into your mid/late 30s (women). And it is that starting process that can also cost lots of money, time, and energy.
As two-kid dad, I definitely agree that the time, energy, and cost of delivering and raising kids is HUGE. It's not something that you should undervalue at all.
But I think we have this unfortunate habit of severely underweighting the start process and things that aren't obvious.
You probably experience lots of stress over the span of raising a kid (or more). Other people see that in the classic screaming-kid seemingly-helpless-parent visual. You may also experience that same stress, perhaps cumulatively more, just from the start because it's (1) VERY stressful when it doesn't work, and (2) a situation that can drag on for what feels like forever.
So, everyone commiserates over work it is to raise a kid but few people talk openly or at all about how hard it is to start the process of having a kid.
That's why I mentioned boarding schools, you don't have to live there to send your kids to it and also it might be good for them, nurture independence and a lot of experience with a foreign culture while also giving you flexibility and easing the burden of child raising.