Robust Agent Compensation (RAC): Teaching AI Agents to Compensate
About
We present Robust Agent Compensation (RAC), a log-based recovery paradigm (providing a safety net) implemented through an architectural extension that can be applied to most Agent frameworks to support reliable executions (avoiding unintended side effects). Users can choose to enable RAC without changing their current agent code (e.g., LangGraph agents). The proposed approach can be implemented in most existing agent frameworks via their existing extension points. We present an implementation based on LangChain, demonstrate its viability through the $\tau$-bench and REALM-Bench, and show that when solving complex problems, RAC is 1.5-8X or more better in both latency and token economy compared to state-of-the-art LLM-based recovery approaches.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Agentic Task Completion | τ2-bench Airline | Success Rate97 | 22 | |
| Job scheduling with permanent disruptions | τ2-bench+ REALM-bench+ P13 v1 (test) | Success Rate3 | 5 | |
| Job scheduling with temporary disruptions | τ2-bench+ / REALM-bench+ P12 v1 (test) | Success Count3 | 5 | |
| Task with Predictable Failures | REALM-Bench P11 | Success Rate1 | 5 | |
| Task with Predictable Failures | REALM-Bench P5 | Success Count3 | 5 | |
| Task with Predictable Failures | REALM-Bench P6 | Result Success Rate3 | 5 | |
| Task with Predictable Failures | REALM-Bench P8 | Success Count3 | 5 | |
| Task with Predictable Failures | REALM-Bench P9 | Result Success Rate1 | 5 | |
| Agentic Task Completion | τ2-bench Retail | Success Rate100 | 4 | |
| Group Booking with failures (Grand Rollback) | τ2-bench+ / REALM-bench+ P14 v1 (test) | Result Success Rate2 | 4 |