Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planning

About

This paper introduces SagaLLM, a structured multi-agent architecture designed to address four foundational limitations of current LLM-based planning systems: unreliable self-validation, context loss, lack of transactional safeguards, and insufficient inter-agent coordination. While recent frameworks leverage LLMs for task decomposition and multi-agent communication, they often fail to ensure consistency, rollback, or constraint satisfaction across distributed workflows. SagaLLM bridges this gap by integrating the Saga transactional pattern with persistent memory, automated compensation, and independent validation agents. It leverages LLMs' generative reasoning to automate key tasks traditionally requiring hand-coded coordination logic, including state tracking, dependency analysis, log schema generation, and recovery orchestration. Although SagaLLM relaxes strict ACID guarantees, it ensures workflow-wide consistency and recovery through modular checkpointing and compensable execution. Empirical evaluations across planning domains demonstrate that standalone LLMs frequently violate interdependent constraints or fail to recover from disruptions. In contrast, SagaLLM achieves significant improvements in consistency, validation accuracy, and adaptive coordination under uncertainty, establishing a robust foundation for real-world, scalable LLM-based multi-agent systems.

Edward Y. Chang, Longling Geng• 2025

Related benchmarks

TaskDatasetResultRank
Agentic Task Completionτ2-bench Airline
Success Rate97
22
Job scheduling with permanent disruptionsτ2-bench+ REALM-bench+ P13 v1 (test)
Success Rate2
5
Task with Predictable FailuresREALM-Bench P5
Success Count3
5
Task with Predictable FailuresREALM-Bench P6
Result Success Rate3
5
Task with Predictable FailuresREALM-Bench P8
Success Count3
5
Task with Predictable FailuresREALM-Bench P9
Result Success Rate1
5
Job scheduling with temporary disruptionsτ2-bench+ / REALM-bench+ P12 v1 (test)
Success Count1
5
Task with Predictable FailuresREALM-Bench P11
Success Rate0.6667
5
Agentic Task Completionτ2-bench Retail
Success Rate98
4
Group Booking with failures (Grand Rollback)τ2-bench+ / REALM-bench+ P14 v1 (test)
Result Success Rate1
4
Showing 10 of 11 rows

Other info

Follow for update