Ha I mean yeah. If you have enough, you can just buy a lot and build and not care about cost.
The problem is those that would've been in the first time homebuyer mix previously, now aren't. And they are getting hit from multiple angles. Higher mortgage rates for them. And those higher rates capping mobility and locking people into their current homes.
I mean, I live in the suburban midwest. Average house in my neighborhood maybe $600-$700k? We have multiple friends that have always talked about how they'd like to have the experience of building a home. Household incomes of $350k+, and massive equity on their current homes so they could build no problem. But even they are like "Nope, we'll wait." They have mortgages like mine (15 year, 2.5% so close to interest free) and simply don't want to "pay up" to build. So these houses that would be on the market with lower rates, now aren't. Which pushes the prices on the homes that are available up, and squeezes out a lot of first time home buyers (even those who earn good $).