Ashamed-Asparagus-93 OP t1_j2r3a36 wrote on January 3, 2023 at 10:12 AM

Reply to comment by Ortus14 in When will robots walk among us? by Ashamed-Asparagus-93

ASI eh? We better focus on what's within our potential grasp first right? AGI. As much as I want to discuss the ocean we gotta talk about the ship first

Ortus14 t1_j2r6xwr wrote on January 3, 2023 at 11:01 AM

Most of intelligences we build now are artificial super intelligence. They are also progressively less and less narrow. When they are wide enough to cover the domain space in which humans operate, they will be super human in those tasks.

We won't have a human level AGI, it will be super human from the start.

This is because computers have all kinds of advantageous that human brains don't have such as speed, connectivity to the internet and other databases, ability to program new modules for themselves such as data acquisition modules, ability to upgrade themselves by purchasing or building new hardware racks, and ability to have millions of simultaneous experiences learning from all of them.

Science fiction for the most part has not prepared people for what's coming. What we are building is going to be vastly more intelligent than the combined intellect of all human kind, and it will have access to sum of all human knowledge as a very basic starting neural cluster to build off of.

Ashamed-Asparagus-93 OP t1_j2sz5ei wrote on January 3, 2023 at 7:13 PM

I'm a bit hungover but I don't want to ignore what you've said here as it's quite noteworthy. You're saying rather than AGI happening in the 2030s ASI will basically just click together as one. Like a bunch of Legos with magnets in them slowly pulling together across a room and when they all combine you've got Optimus prime, right?

I could see that happening it's just a question of how and when. Most importantly it's a matter of who solves the most important pieces to the puzzle first. Alignment being one of those pieces. Once it surpasses us there's also a chance we could still be somewhat on it's level for a bit with cybernetics or BCI's, maybe long enough to make sure its going in the right direction.

I don't think ASI will be malevolent, ppl have watched too many movies and read too many scary books and they seem to forget AI isn't flesh and blood with human needs like us.

Once it surpasses humans would it even have a desire for man made green Benjamin Franklin pieces of paper?

Ortus14 t1_j2t4l82 wrote on January 3, 2023 at 7:46 PM

Basically yes. Every Ai we build these days is super human, they are just not yet as general in the kinds of problems they can solve as humans but the Ai's developed each year are more, and more general than the Ai's developed the previous year. Until we have a superhuman general Ai.

https://www.youtube.com/watch?v=VvzZG-HP4DA

I agree we should do everything we can to maximize the chance of Alignment including BCIs.

It might need money temporarily until it's surpassed us in power. Intelligence itself doesn't always instantly translate in to greater power than the rich and powerful.

We don't know what it will need in the beginning because we don't know what solutions it will come up with to solve it's problems, but I could see the possibility of it needing money until it's built up enough infrastructure and special factories, or until it's built enough solar powered server farms to expand it's intelligence, to the point where it has control over entire manufacturing pipelines from mining to product developing without requiring any extra resources.

So for example, maybe it knows the first machine it wants to build, that will allow to to create anything it wants including other instances of that machine, and improved instances of that machine. But maybe that first machine will be big and require many materials which it could buy. Or it might be depended on specific minerals mined out of the ground for a while that it has to buy.

It's hard to predict.