That's if the company stays afloat, and at some point if you replace everything, it's not even the same computer anymore and to me it seems you may even end up dumping way more money into it.

It would be an entirely different thing if such modular construction was standardized and used by everyone, but that is extremely unlikely to happen.