Submitted by Singularian2501 t3_126wvkq in MachineLearning

Paper: https://arxiv.org/abs/2303.16434

Abstract:

>Artificial Intelligence (AI) has made incredible progress recently. On the one hand, advanced foundation models like ChatGPT can offer powerful conversation, in-context learning and code generation abilities on a broad range of open-domain tasks. They can also generate high-level solution outlines for domain-specific tasks based on the common sense knowledge they have acquired. However, they still face difficulties with some specialized tasks because they lack enough domain specific data during pre-training or they often have errors in their neural network computations on those tasks that need accurate executions. On the other hand, there are also many existing models and systems (symbolic-based or neural-based) that can do some domain specific tasks very well. However, due to the different implementation or working mechanisms, they are not easily accessible or compatible with foundation models. Therefore, there is a clear and pressing need for a mechanism that can leverage foundation models to propose task solution outlines and then automatically match some of the sub tasks in the outlines to the off-the-shelf models and systems with special functionalities to complete them. Inspired by this, we introduce TaskMatrix.AI as a new AI ecosystem that connects foundation models with millions of APIs for task completion. Unlike most previous work that aimed to improve a single AI model, TaskMatrix.AI focuses more on using existing foundation models (as a brain-like central system) and APIs of other AI models and systems (as sub-task solvers) to achieve diversified tasks in both digital and physical domains. As a position paper, we will present our vision of how to build such an ecosystem, explain each key component, and use study cases to illustrate both the feasibility of this vision and the main challenges we need to address next.

https://preview.redd.it/0guexiznhxqa1.jpg?width=979&format=pjpg&auto=webp&v=enabled&s=991dbd3c6db195450870f545f4f48657aec2d8eb

94

Comments

You must log in or register to comment.

IntrepidTieKnot t1_jebtzyj wrote

Isn't this basically the description of Langchain?

23

danielbln t1_jebwikt wrote

Yeah, sounds exactly like chain of thought reasoning with tools, so langchain and also ChatGPT plugins.

9

sebzim4500 t1_jecbyml wrote

I think the 'feedback to api developers' idea is novel and useful.

4

joondori21 t1_jeckdey wrote

There’s been like 5 renditions of the same concept of this already

17

kulchacop t1_jectkc3 wrote

  • TaskMatrix.AI
  • LangChain
  • Toolformer
  • ChatGPT plugins

What else we got?

22

Philpax t1_jed8s0x wrote

ReAct

7

LetGoAndBeReal t1_jef6vjx wrote

Right, ReAct seems to be the core pattern that everyone - including LangChain with their agents and OpenAI with their plugins - is using.

6