Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework

About

Remarkable progress has been made on automated problem solving through societies of agents based on large language models (LLMs). Existing LLM-based multi-agent systems can already solve simple dialogue tasks. Solutions to more complex tasks, however, are complicated through logic inconsistencies due to cascading hallucinations caused by naively chaining LLMs. Here we introduce MetaGPT, an innovative meta-programming framework incorporating efficient human workflows into LLM-based multi-agent collaborations. MetaGPT encodes Standardized Operating Procedures (SOPs) into prompt sequences for more streamlined workflows, thus allowing agents with human-like domain expertise to verify intermediate results and reduce errors. MetaGPT utilizes an assembly line paradigm to assign diverse roles to various agents, efficiently breaking down complex tasks into subtasks involving many agents working together. On collaborative software engineering benchmarks, MetaGPT generates more coherent solutions than previous chat-based multi-agent systems. Our project can be found at https://github.com/geekan/MetaGPT

Sirui Hong, Mingchen Zhuge, Jiaqi Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, J\"urgen Schmidhuber• 2023

Related benchmarks

TaskDatasetResultRank
Code GenerationHumanEval
Pass@196.2
850
Code GenerationHumanEval (test)
Pass@195.8
444
Code GenerationMBPP (test)
Pass@192.3
276
Automated PlanningPDDL
Accuracy25.61
233
Question AnsweringPopQA
Accuracy48.42
186
Mathematical ReasoningGSM8K--
177
Code GenerationMBPP
Accuracy (%)81.7
146
Question AnsweringStrategyQA
Accuracy62.88
114
Code GenerationMBPP
Pass@187.7
113
Code GenerationMBPP
Accuracy87.7
90
Showing 10 of 29 rows

Other info

Follow for update