Most of the scarcity around houses are artificial. Home owners want housing to be scarce because they have an expectation of property value going up, forever.
If housing becomes more abundant, a lot of middle class people become decidedly poor. Well... that's bad. And they're the voters, so is that going to happen? No.
We can build denser, cheaper per-unit housing. We decide not to, because the only people that want that are the ones who don't have a house. As soon as they get a house their opinion will change.
Yes, resource scarcity is a key factor underlying society's problems.