Viewing a single comment thread. View all comments

MetaAI_Official OP t1_izfod3v wrote

Reply to comment by AnArgumentativeFool in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official

We were originally targeting 24hr-turn games, but ended up pivoting to 5min-turn games due to the inability to gather a sufficient number of samples in the 24hr-turn format (as playing a single game can sometimes take months)! Playing 24hr-turn games would indeed pose additional challenges from a language generation perspective — while human players tend to send a similar number of messages in each format, messages in 24hr turns tend to be signficantly longer (and likely more complex). Moreover, human players would have more time to interrogate mistakes from the bot, which could potentially lead to the agent making further mistakes. -ED

1

MetaAI_Official OP t1_izfq8y9 wrote

[Goff] There's also some interesting "anti-weirdness" steps that the team worked on that would need to be put in place - an AI that responds to messages within five minutes 24 hours a day would not feel right at all. I think the most intense timeframe is probably 15 to 30 minutes, as then you will need longer, more complex communications but also the rapid tactical back-and-forth - that pivot would be a cool challenge.

2