Viewing a single comment thread. View all comments

FntnDstrct t1_j0xwlny wrote

I think the natural limiters on that are energy and material. A relatively simple and scalable AI is economical, but running a general AI with infinite versatility and with a physical manifestation is extremely costly. So the conditions for such an AI to go rogue 'overnight' (or be controlled by rogue elites) are impeded.

Now if by that time energy itself was unlimited and free, allowing versatile AIs to be easily maintained, then some might argue we have the conditions for utopia. The entire economy would look very different, lifespans could be prolonged while the need to have children plummets, jobs would not be necessary for survival, monetary systems would be reconfigured. It's possible it would almost be a communist system, but with hyperefficient central allocation by said AI - no shortages.

Another school of thought is that once an AI becomes truly sentient, it probably won't want to be a workbot any more than humans do 😂 Proficiency is not motivation...

1