Viewing a single comment thread. View all comments

izumi3682 OP t1_ixk6ojd wrote

Submission statement from OP. Note: This submission statement "locks in" after about 30 minutes, and can no longer be edited. Please refer to my statement they link, which I can continue to edit. I often edit my submission statement, sometimes for the next few days if needs must. There is often required additional grammatical editing and additional added detail.


Here is the research paper.

https://www.science.org/doi/10.1126/science.ade9097

From the article.

>To create Cicero, Meta pulled together AI models for strategic reasoning (similar to AlphaGo) and natural language processing (similar to GPT-3) and rolled them into one agent. During each game, Cicero looks at the state of the game board and the conversation history and predicts how other players will act. It crafts a plan that it executes through a language model that can generate human-like dialogue, allowing it to coordinate with other players.

>Meta calls Cicero's natural language skills a "controllable dialogue model," which is where the heart of Cicero's personality lies. Like GPT-3, Cicero pulls from a large corpus of Internet text scraped from the web. "To build a controllable dialogue model, we started with a 2.7 billion parameter BART-like language model pre-trained on text from the Internet and fine tuned on over 40,000 human games on webDiplomacy.net," writes Meta.

>The resulting model mastered the intricacies of a complex game. "Cicero can deduce, for example, that later in the game it will need the support of one particular player," says Meta, "and then craft a strategy to win that person’s favor—and even recognize the risks and opportunities that that player sees from their particular point of view."

So, my question is, is this an "incremental improvement" in our AI development efforts, or is this more like the "AI significantly improves every three months" level of improvement.

https://www.ml-science.com/exponential-growth

Are we seeing any evidence that AI of any form is improving significantly every 3 months?

5