A housing policy commentator challenged the mainstream consensus that simply building more homes would fix affordability