Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machines

About

Large Language Models (LLMs) have demonstrated the ability to solve a wide range of practical tasks within multi-agent systems. However, existing human-designed multi-agent frameworks are typically limited to a small set of pre-defined scenarios, while current automated design methods suffer from several limitations, such as the lack of tool integration, dependence on external training data, and rigid communication structures. In this paper, we propose MetaAgent, a finite state machine based framework that can automatically generate a multi-agent system. Given a task description, MetaAgent will design a multi-agent system and polish it through an optimization algorithm. When the multi-agent system is deployed, the finite state machine will control the agent's actions and the state transitions. To evaluate our framework, we conduct experiments on both text-based tasks and practical tasks. The results indicate that the generated multi-agent system surpasses other auto-designed methods and can achieve a comparable performance with the human-designed multi-agent system, which is optimized for those specific tasks.

Yaolun Zhang, Xiaogeng Liu, Chaowei Xiao• 2025

Related benchmarks

TaskDatasetResultRank
Multi-agent system task solvingBrowsecomp
Accuracy60.1
21
Multi-agent system task solvingFinance
Accuracy34.9
21
Multi-agent system task solvingWorkBench
Accuracy46.9
21
Multi-agent system task solvingPlancraft
Accuracy56
21
Question AnsweringDROP
Accuracy78.16
6
Code GenerationMBPP
Accuracy79.86
6
Code GenerationHumanEval
Accuracy74.08
6
Mathematical ReasoningAIME
Accuracy26.67
6
Showing 8 of 8 rows

Other info

Follow for update