Not the types of partners we're talking about, not in this part of the world. I suppose if some Yemenese or Saudi has 4 wives, it's technically that many fewer you could potentially have...
The logic works out "close enough". You don't really live near any FLDS compounds anyway.
Legal marriage isn't the only form of polygynous relationships. Polycules and ENM communities often have more women than men. Or just a man having a mistress or otherwise having more than one partner not necessarily even joining a specific subculture.
You don't need to live near a FLDS compound to find people engaging in non-monogamous relationships.
The logic works out "close enough". You don't really live near any FLDS compounds anyway.