MemoryAgentBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Memory Agent Performance | MemoryAgentBench | Access Rate83 | 44 | |
| Memory-Augmented Agent Evaluation | MemoryAgentBench | Single-Hop Accuracy28.7 | 16 | |
| Long-context memory management | MemoryAgentBench | Single-Doc Recall83 | 16 | |
| End-to-end agent-loop performance | MemoryAgentBench | Pre-Verify Success Rate80 | 10 | |
| Conflict Resolution | MemoryAgentBench conflict-bearing subset official | Final Accuracy100 | 10 | |
| Agentic Memory Retrieval | MemoryAgentBench | Access Rate82 | 10 | |
| Fact Consolidation (Single-Hop) | MemoryAgentBench (MAB) FC-SH 262K | Accuracy93 | 8 | |
| Conflict resolution and memory verification | MemoryAgentBench conflict-bearing slice | Accuracy100 | 7 | |
| Fact Consolidation (Multi-Hop) | MemoryAgentBench (MAB) FC-MH 262K | Accuracy27 | 5 | |
| Fact Consolidation (Single-Hop) | MemoryAgentBench FC-SH Average | Accuracy0.948 | 4 | |
| Fact Consolidation (Single-Hop) | MemoryAgentBench (MAB) FC-SH 64K | Accuracy95 | 4 | |
| Fact Consolidation (Single-Hop) | MemoryAgentBench (MAB) FC-SH 32K | Accuracy92 | 4 | |
| Fact Consolidation (Multi-Hop) | MemoryAgentBench (MAB) FC-MH Average | Accuracy30.2 | 1 | |
| Fact Consolidation (Multi-Hop) | MemoryAgentBench (MAB) FC-MH 64K | Accuracy33 | 1 | |
| Fact Consolidation (Multi-Hop) | MemoryAgentBench FC-MH 32K | Accuracy27 | 1 | |
| Fact Consolidation (Multi-Hop) | MemoryAgentBench (MAB) FC-MH 6K | Accuracy34 | 1 |
Showing 16 of 16 rows