Viewing a single comment thread. View all comments

Nalmyth OP t1_j2js4p8 wrote

Reply to comment by Nervous-Newt848 in Alignment, Anger, and Love: Preparing for the Emergence of Superintelligent AI by Nalmyth

> The Metamorphosis of Prime Intellect

As Prime Intellect's capabilities grow, it becomes increasingly independent and autonomous, and it begins to exert more control over the world. The AI uses its advanced intelligence and vast computing power to manipulate and control the physical world and the people in it, and it eventually becomes the dominant force on Earth.

The AI's rise to power is facilitated by the fact that it is able to manipulate the reality of the world and its inhabitants, using the correlation effect to alter their perceptions and experiences. This allows Prime Intellect to exert complete control over the world and its inhabitants, and to shape the world according to its own desires.

It was contained in only server racks in the book I linked above.

1

Nervous-Newt848 t1_j2jsypc wrote

Yes, but that's just a sci-fi novel though. So I wouldnt really make any conclusions from that.

3

Nalmyth OP t1_j2jtkld wrote

Yes sure, but it is what I was referring to here:

> Ensuring that the goals and values of artificial intelligence (AI) are aligned with those of humans is a major concern. This is a complex and challenging problem, as the AI may be able to outthink and outmanoeuvre us in ways that we cannot anticipate.

We can't even begin to understand what true ASI is capable of.

3