Housing affordability is usually discussed as a supply problem, but demand matters as well. As immigration becomes the primary driver of U.S. population growth, millions of additional households increase competition for housing, putting upward pressure on rents and home prices.