A new study from the Federal Reserve Bank of Minneapolis found a more than 60% drop in homebuyers with modest budgets from 2021-24. Meanwhile, sales of more expensive homes rose.