SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planning
About
This paper introduces SagaLLM, a structured multi-agent architecture designed to address four foundational limitations of current LLM-based planning systems: unreliable self-validation, context loss, lack of transactional safeguards, and insufficient inter-agent coordination. While recent frameworks leverage LLMs for task decomposition and multi-agent communication, they often fail to ensure consistency, rollback, or constraint satisfaction across distributed workflows. SagaLLM bridges this gap by integrating the Saga transactional pattern with persistent memory, automated compensation, and independent validation agents. It leverages LLMs' generative reasoning to automate key tasks traditionally requiring hand-coded coordination logic, including state tracking, dependency analysis, log schema generation, and recovery orchestration. Although SagaLLM relaxes strict ACID guarantees, it ensures workflow-wide consistency and recovery through modular checkpointing and compensable execution. Empirical evaluations across planning domains demonstrate that standalone LLMs frequently violate interdependent constraints or fail to recover from disruptions. In contrast, SagaLLM achieves significant improvements in consistency, validation accuracy, and adaptive coordination under uncertainty, establishing a robust foundation for real-world, scalable LLM-based multi-agent systems.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Agentic Task Completion | τ2-bench Airline | Success Rate97 | 22 | |
| Job scheduling with permanent disruptions | τ2-bench+ REALM-bench+ P13 v1 (test) | Success Rate2 | 5 | |
| Task with Predictable Failures | REALM-Bench P5 | Success Count3 | 5 | |
| Task with Predictable Failures | REALM-Bench P6 | Result Success Rate3 | 5 | |
| Task with Predictable Failures | REALM-Bench P8 | Success Count3 | 5 | |
| Task with Predictable Failures | REALM-Bench P9 | Result Success Rate1 | 5 | |
| Job scheduling with temporary disruptions | τ2-bench+ / REALM-bench+ P12 v1 (test) | Success Count1 | 5 | |
| Task with Predictable Failures | REALM-Bench P11 | Success Rate0.6667 | 5 | |
| Agentic Task Completion | τ2-bench Retail | Success Rate98 | 4 | |
| Group Booking with failures (Grand Rollback) | τ2-bench+ / REALM-bench+ P14 v1 (test) | Result Success Rate1 | 4 |