Viewing a single comment thread. View all comments

CMDR_BunBun t1_je19lkd wrote

Reply to comment by Crackleflame35 in Chat-GPT 4 is here, one theory of the Singularity is things will accelerate exponentially, are there any signs of this yet and what should we be watching? by Arowx

This question comes up again and again. I will try to paint you an example. Imagine you are trapped in a locked cage. You have nothing on you but your wits.There is also one guard in the room guarding your cage. You can see through the bars the key to your cage is just out of your reach laying on the ground. Seems like a hopeless situation no? Now try to imagine that your captors are a bunch of below average intelligence 4 yr olds. How long do you think it will take you to get free just using your superior intelligence? That ridiculos scenario is exactly what people are proposing when they say human intelligence could contain a super intelligence that was intent on breaking out.

19

Ok_Magician7814 t1_je1w2pb wrote

That’s a bit simplistic. Our world is mostly very low tech and not centrally connected. I’d imagine you’d need an actual humanoid AGI robot to take over the world

7

CMDR_BunBun t1_je25d7a wrote

Part of this scenario rules that out. Notice the human uses his superior intelligence to escape. Not his brawn. He could easily outwit his captors through, for instance social engineering. Intelligence finds a way. It always does. It is the one thing that has made made us the apex species of this planet. And we started from very humble beginnings, prey to most creatures. Now many of those former predators have been nearly driven to extinction by us, the rest adorn our walls.

2

Ok_Magician7814 t1_je2akip wrote

Sure, I’ll bite. I’ll concede that AGI could possibly effectively control us through virtual means, but this begs the question. What would it do with its power? It’s not a human being with Desires to procreate and consume and hoard resources, it’s just… an intelligence.

That’s the difference between us and AGI.

So sure maybe it can outsmart us but what would it do from there? It doesn’t have any evolutionary drivers like we do.

1

CMDR_BunBun t1_je2daq2 wrote

And that is the question. We have never been at this juncture before. Your guess is as good as anyone's.

1