it's not like large numbers of 100-year-old houses in the places we're talking about have been destroyed (through natural processes - we're not talking about whether buildings can survive a bomb blast).

You can't have a survivorship bias if the vast majority of things from the population survived.