Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms

About

The rise of powerful large language models (LLMs) has spurred a new trend in building LLM-based autonomous agents for solving complex tasks, especially multi-agent systems. Despite the remarkable progress, we notice that existing works are heavily dependent on human-designed frameworks, which greatly limits the functional scope and scalability of agent systems. How to automatically extend the specialized agent to multi-agent systems to improve task-solving capability still remains a significant challenge. In this paper, we introduce EvoAgent, a generic method to automatically extend specialized agents to multi-agent systems via the evolutionary algorithm, thereby improving the effectiveness of LLM-based agents in solving tasks. Specifically, we consider the existing agent frameworks as the initial individual and then apply a series of evolutionary operators (e.g., mutation, crossover, selection, etc.) to generate multiple agents with diverse settings. Experimental results across various tasks show that EvoAgent can significantly enhance the task-solving capability of LLM-based agents, and can be generalized to any LLM-based agent framework to extend them into multi-agent systems. Resources are available at https://evo-agent.github.io/.

Siyu Yuan, Kaitao Song, Jiangjie Chen, Xu Tan, Dongsheng Li, Deqing Yang• 2024

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningAIME 2024
Pass@1 Accuracy66.67
243
Mathematical ReasoningAIME 2025
Pass@1 Accuracy43.33
192
Embodied TaskAlfWorld--
183
Travel PlanningTravelPlanner (val)
Delivery Rate100
42
Web-based researchDeepResearchBench (test)
Accuracy52.91
28
Mathematical ReasoningHumanity's Last Exam Math (test)
Accuracy27.38
28
Multi-hop dynamic question answeringBrowseComp+ (test)
Accuracy (%)23.81
28
Multi-tool callingVitaBench held-out (test)
Success Rate61.9
28
Multi-task agent evaluationSkill-MAS Evaluation Suite Aggregate
Average Performance (%)34.3
28
Long horizon planningTravelPlanner
Delivery Rate95.6
13
Showing 10 of 20 rows

Other info

Follow for update