Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ReDel: A Toolkit for LLM-Powered Recursive Multi-Agent Systems

About

Recently, there has been increasing interest in using Large Language Models (LLMs) to construct complex multi-agent systems to perform tasks such as compiling literature reviews, drafting consumer reports, and planning vacations. Many tools and libraries exist for helping create such systems, however none support recursive multi-agent systems -- where the models themselves flexibly decide when to delegate tasks and how to organize their delegation structure. In this work, we introduce ReDel: a toolkit for recursive multi-agent systems that supports custom tool-use, delegation schemes, event-based logging, and interactive replay in an easy-to-use web interface. We show that, using ReDel, we are able to easily identify potential areas of improvements through the visualization and debugging tools. Our code, documentation, and PyPI package are open-source and free to use under the MIT license at https://github.com/zhudotexe/redel.

Andrew Zhu, Liam Dugan, Chris Callison-Burch• 2024

Related benchmarks

TaskDatasetResultRank
Text-to-SQLEHRSQL
Execution Accuracy26.8
69
Database Question AnsweringLS-Hard (test)
Answer Accuracy40.2
8
Question AnsweringLS-Hard
Accuracy40.2
8
Database Question AnsweringRealEHR (test)
Accuracy44.8
8
Question AnsweringRealEHR
Accuracy44.8
8
Database Question AnsweringEHRSQL (test)
Execution Accuracy26.8
8
Showing 6 of 6 rows

Other info

Follow for update