I think little people should live in tiny houses and big people should live in big houses.
I think this makes the most sense to me. So, all children from 3 years old can have a tiny house until they grow too big for it, then they can move into bigger houses.