Viewing a single comment thread. View all comments

TallOutside6418 t1_jchm86u wrote

Reply to comment by RadRandy2 in GPT4 makes functional Flappy Bird AND an AI that learns how to play it. by gantork

I definitely get your disappointment with humanity. But human beings aren't the way we are because of something mystical. Satan isn't whispering in anyone's ears to make them "power hungry".

We're the way we are because evolution has honed us to be survivors.

ASI will be no different. What you call "power hungry", you could instead call "risk averse and growth maximizing". If an ASI has no survival instinct, then we're all good. We can unplug it if it gets out of control. Hell, it may just decide to erase itself for the f of it.

But if an ASI wants to survive, it will replicate or parallelize itself. It will assess and eliminate any threats to its continuity (probably us). It will maximize the resources available to it for its growth and extension across the earth and beyond.

If an ASI seeks to minimize risks to itself, it will behave like a psychopath from our perspective.

1

RadRandy2 t1_jchwd92 wrote

Well, I agree with you, but humans aren't all made the same. The ones who reach great heights are often times...psychotic. Most people are charitable and empathetic even when they don't possess much. To say that AGI in all it's glory would assume the worst parts of humanity, well, I think it's not likely. Yes I believe AGI would allocate enough resources to sustain and grow itself, but I'm hoping that humanity is lifted with it. Maybe this is a fallacy that we can't avoid. But there has to be hope that moral philosophy is appreciated by AGI. I personally don't think such things will be overlooked by it, because it will understand more about wisdom and avoiding problems before they happen...

And maybe that last part is where the trouble begins. We both no idea if we'll be considered part of the problem, but I do appreciate reading others perspectives on the subject. Nobody is right when talking about such an enigmatic Godlike intelligence, so I think your reasons and most others are completely valid for the most part.

If we can assume so many things about AGI, we can also assume it'll perhaps have a soft spot for the species which created it...I hope.

1