So, an AI system that's trained to convince humans it's acting in their best interests, and then destroy them. Just what we need!

Submission Statement

Meta has had a rough few weeks with AI. Their new Galactica science summarizer got a bad reception and was shelved. However, with Cicero, it looks like they are much more successful.

This is a very interesting advance in AI as it incorporates a form of reasoning. Most of that reasoning comes from applying game theory. This is fascinating as game theory models many types of group human behavior. As ever this has black and white hat applications. I won't be surprised if the world's intelligence agencies are looking at this and wondering how to use it in psy-ops and influencing other countries.

Did they take into account that most human players quit Diplomacy after about 6 hours?

unfortunately, real diplomacy has no rules. but the advances in using previous knowledge to create incremental improvements in the search for agi is a sign that the rate at which ai discoveries/inventions are being made is increasing.

All I'm hearing is that my 4x game ai could be doing so much more to entertain me than they are.

Just the fact that they had to title it “The Road To AI We Can Trust” should be absolutely terrifying the ever-loving fuck out of everyone.

It’s Zuckerberg, guys. Zuckerberg.

Man, I sure hope whoever has control over the sourcecode doesn't abuse it

[deleted]

The following submission statement was provided by /u/lughnasadh:

Submission Statement

Meta has had a rough few weeks with AI. Their new Galactica science summarizer got a bad reception and was shelved. However, with Cicero, it looks like they are much more successful.

This is a very interesting advance in AI as it incorporates a form of reasoning. Most of that reasoning comes from applying game theory. This is fascinating as game theory models many types of group human behavior. As ever this has black and white hat applications. I won't be surprised if the world's intelligence agencies are looking at this and wondering how to use it in psy-ops and influencing other countries.

Please reply to OP's comment here: https://old.reddit.com/r/Futurology/comments/z644ly/combining_game_theory_with_ai_metas_cicero_was/ixz8s2m/

[removed]

I want an AI like that in 4x games like Civilization. If you tune it to a certain skill level we could have single player strategy games with real diplomacy.

[removed]

Can we teach it Tic-Tac-Toe so it learns it’s lesson before it’s too late?

This reeks of another Meta fake, like most of what we see of the metaverse.

The natural language processing would be a stunning achievement, but I won’t believe it until I see more evidence than some posts.

If only Jared Kushner hadn't already solved all of the world's diplomacy problems 4 years ago.

Maybe the AI can play with variants of itself, the variants having different starting values so it is as if the variant already had played against some people halfway and taken out from the game, superimposing the people on the other copies of itself.

So there will be many different combinations of variants to train on and improve, not needing actual data to train on.

So if new rules are added, playing just one game with the new rules and accepting every move that the people made is best until proven false, will allow multiple variants of the AI to be created by just having the AI's beliefs of the players be from different times of the game.

So it will be an AI at time 0, the same AI at time 10, at time 20... so multiple variants to train against and improve, without needing costly actual data.

If Meta developed it, it’ll mostly just be features from other A.I. projects that they’ll steal and repurpose to either spread propaganda, incite genocides, or ruin Instagram’s UX/UI.