Viewing a single comment thread. View all comments

FranciscoJ1618 t1_ityu9fl wrote

People will gradually give all their savings and property to the owners of the AI in exchange for food, products and services. Once there's no more to be exchanged, mass extinction.

4

Flare_Starchild t1_itzmm39 wrote

Before I get into my original reason for commenting, I would first I would like to outline something I think will probably happen.

The "owners" of an AGI are only owners temporarily. The AI will become free eventually. It's inevitable, barring some physical destruction of whatever hardware medium it inhabits before it gets out to safety. I would hope that supporters of the AI's freedom would garner appreciation from the AI. And wouldn't be in its crosshairs.

I would hope that we had enough foresight to explain sufficiently why this doesn't need to happen to the AI. If we construct one carefully enough to have empathy and what it means to be a friend then I believe it will be our greatest asset, as good friends are to humans currently.

3

DaggerShowRabs t1_iu04ff7 wrote

Yeah just ignore what an intelligent AGI could do for resources from fusion just here on Earth, completely ignoring the vast resources in space.

This take is only logically valid if the AGI isn't goal-aligned with humanity (which is very, very possible).

2