Submitted by ykilcher t3_z4s2kp in MachineLearning

https://youtu.be/ciNMc0Czmfc

A team from Meta AI has developed Cicero, an agent that can play the game Diplomacy, in which players have to communicate via chat messages to coordinate and plan into the future.

​

OUTLINE:

0:00 - Introduction

9:50 - AI in cooperation games

13:50 - Cicero agent overview

25:00 - A controllable dialogue model

36:50 - Dialogue-conditional strategic planning

49:00 - Message filtering

53:45 - Cicero's play against humans

55:15 - More examples & discussion

​

Homepage: https://ai.facebook.com/research/cicero/

Code: https://github.com/facebookresearch/diplomacy_cicero

Blog: https://ai.facebook.com/blog/cicero-ai-negotiates-persuades-and-cooperates-with-people/

Paper: https://www.science.org/doi/10.1126/science.ade9097

​

Abstract:

Despite much progress in training AI systems to imitate human language, building agents that use language to communicate intentionally with humans in interactive environments remains a major challenge. We introduce Cicero, the first AI agent to achieve human-level performance in Diplomacy, a strategy game involving both cooperation and competition that emphasizes natural language negotiation and tactical coordination between seven players. Cicero integrates a language model with planning and reinforcement learning algorithms by inferring players' beliefs and intentions from its conversations and generating dialogue in pursuit of its plans. Across 40 games of an anonymous online Diplomacy league, Cicero achieved more than double the average score of the human players and ranked in the top 10% of participants who played more than one game.

​

Authors: Anton Bakhtin, Noam Brown, Emily Dinan, Gabriele Farina, Colin Flaherty, Daniel Fried, Andrew Goff, Jonathan Gray, Hengyuan Hu, Athul Paul Jacob, Mojtaba Komeili, Karthik Konath, Minae Kwon, Adam Lerer, Mike Lewis, Alexander H. Miller, Sasha Mitts, Adithya Renduchintala, Stephen Roller, Dirk Rowe, Weiyan Shi, Joe Spisak, Alexander Wei, David Wu, Hugh Zhang, Markus Zijlstra

145

Comments

You must log in or register to comment.

Lucas_Matheus t1_ixswszk wrote

Is this actually Yannic? I read Meta's blog post about Cicero yesterday. I really like this video series. Will definitely watch it

7

ykilcher OP t1_iydbkam wrote

not that it helps, but yes it's really me ;)

here are sunglasses --> 🕶️

undeniable proof

2

memberjan6 t1_ixvct37 wrote

WOPPER: Would you like to play a game?

1

dulipat t1_ixvoihf wrote

This has to be a reference to Skyrim's Cicero, right?

−4