Land is a natural resource, and like air or sunlight, nobody deserves to own it more than anybody else.
"But my family has live here for generations!" sounds awful similar to "I deserve it because my great great grandfather killed the people that used to live here."
You get to decide how much the land is worth to you. If you value it honestly and somebody else values it higher, a trade benefits both of you.
Did you plug in some numbers to see how much you pay when you own multiple homes? Rental units are not profitable when people can buy a house for cheaper than your property taxes on the same property. And normal people can do hostile buyouts from corporate landords too.