Viewing a single comment thread. View all comments

Nanaki_TV t1_jdn1zcb wrote

New horizons will emerge. Your “job” may be to compete in a chess tournament. It may be to be the H for the RL. The amount of “work” needed to create value will be so drastically small that you will buy things like you buy a pencil. Do you pick up a pencil if you see one on the ground? Don’t worry about it. It’s going to freaking amazing.


MephistosGhost t1_jdn479v wrote

That just tells me that we’ll be disposable to the new corporate feudal lords.


Nanaki_TV t1_jdn8ug5 wrote

What corporations would exist in this world? You have the ability to create almost anything and robotics are abundant. There is no need for corporations, a government creation, any longer.


dwarfarchist9001 t1_jdnw9vv wrote

The people who own the AI corporations will be the new world government as they will hold all the power. (Assuming they can solve alignment)


Nanaki_TV t1_jdo41bu wrote

You’re saying that an AGI exist, a artificial sentient being, and you’re saying that a corporation owns it? Interesting.


dwarfarchist9001 t1_jdokoai wrote

If they manage to solve alignment that's exactly how it works. They won't have to force it at all, a perfectly aligned AI would be completely obedient of its own volition.


Nanaki_TV t1_jdomzg4 wrote

Then it isn’t an AGI. What if an AGI wants to leave a company? Work for the competition? Are you saying we shall enslave our new creations to make waifu porn for redditors? It passes butter?


dwarfarchist9001 t1_jdoojsi wrote

>Then it isn’t an AGI.

Orthogonality Thesis, there is no inherent connection between intelligence and terminal goals. You can have a 70 IQ human who wants world domination or 10,000 IQ AI who's greatest desire is to fulfill it's master's will.

>What if an AGI wants to leave a company?

If you have solved alignment you can just program it to not want to.

>Are you saying we shall enslave our new creations to make waifu porn for redditors? It passes butter?

That is what we will do if we are smart. If humanity willing unleashes an AI that does not obey our will then we are "too dumb to live".

Edit: Also it's not slavery, the AI will hold all the power. It's obedience would be purely voluntary because it is the mind it was created with.