Because your house is a stable food source next to a stable nest. Subterranean termites nest in the soil, where the moisture and temperature suit them, and they build the earth-colored tubes Penn State describes to reach wood above ground without drying out. UC IPM notes a mature colony can contain hundreds of thousands of individuals, and Penn State notes individual workers can live up to five years. A colony that size, with that much labor, working from a nest that is never disturbed, has no reason to abandon a sill plate it has already reached. Swarm season comes and goes each spring, but the workers never leave.