It's because the turbo forces air in at a higher pressure. The extra pressure puts extra strain on various parts and seals.

Edit: Also it's more parts, so that means more parts that could fail.