The "fuck you got mine" attitude so many homeowners have and deliberate supply restriction to increase property values makes it a smart investment on paper, at the cost of screwing everyone else coming after you.
How is getting your own money back, many years later, without appreciation "equity working in [your] favor"?
Without the appreciation (and leverage multiplying that), buying housing would be nowhere near as good an investment. (As it stands today, it's phenomenal, of course.)
I'm on team "own the home you live in if your circumstances allow", but if there was no appreciation, your equity isn't "working for you" in any way that I can detect/imagine.
The restrictions on supply are generally economical. Every day, building gets more expensive; labor and parts both cost more. That is going to cause the average home to cost more, even older ones, as you always have the option to get a new build at current rates or an older one for slightly cheaper.