It seems much more likely that the driving factor behind their low birth rate is their very high rate of overwork. There have been a number of articles about how impossible it is for a typical salaryman to have enough free time and energy to even care about sex, let alone find a partner.