Viewing a single comment thread. View all comments

sticky_symbols t1_izy5p7j wrote

I think this is exactly right. And I've read a ton of professional writing on AGI safety.

I think some of the people involved are already thinking this way.

It's actually really nice that both the clear leaders in AI also seem to be really ethical people, the sort you'd like to have ruling the world, if someone has to. However, governments and militaries will probably catch on and take over those labs before they get all the way to AGI.

2

OldWorldRevival OP t1_izy65n6 wrote

To me it seems like a sort of inevitable solution, really.

It's like, no matter what we do, we will fail, so the goal is to fail as optimally as possible

1

sticky_symbols t1_izy6q0b wrote

That's right. There are no other plausible proposals for making AGI truly and reliably aligned with humanity's values. But this seems simple enough that it could probably be implemented.

1

OldWorldRevival OP t1_izy77m5 wrote

I think people will get wind of this basically being the plan and we might end up picking someone democratically.

That is, I don't see AI researchers being the ones in control. Politically intelligent people have the highest chance.

Political intelligence tends to follow social intelligence, which also follows general intelligence, but it seems to contradict technical intelligence. I.e. the more technically adept someone is, the less social they are, and the degree to which they can be both reflects their general intelligence. That's my hypothesis anyways...

2

sticky_symbols t1_izy81b1 wrote

Interesting thought. I think you might well be right.

I guess having a politician in charge of the world is better than having humanity ended. :) But they are people who want power, and I find that disturbing. This might be a case where I'd actually prefer a successful actor, and they're pretty good with popularity contests, too. I think that for that purpose, being positive and open-minded would be more important than any knowledge. And you wouldn't need to have someone that smart, just not stupid.

The Rock for god-emperor! Or maybe RDJ can reprise his role as the creator of Ultron...

:)

1