MemoryArena
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Physics Reasoning | MemoryArena Physics | Success Metric11.63 | 20 | |
| Mathematical Reasoning | MemoryArena Math | Success Score10.88 | 20 | |
| Interactive agentic task completion | MemoryArena | Bundled Web Shop PS68 | 14 | |
| Interactive Web Shopping | MemoryArena Bundled Web Shopping | Success Rate (SR)34.67 | 8 | |
| Formal Reasoning | MemoryArena Formal Reasoning 1.0 (test) | Math Success Rate45 | 8 | |
| Web Search | MemoryArena Progressive Web Search 1.0 (test) | Success Rate56.56 | 8 | |
| Travel Planning | MemoryArena Group Travel Planning 1.0 (test) | Success Rate (SR)15.19 | 8 | |
| Web Shopping | MemoryArena Bundled Web Shopping 1.0 (test) | Success Rate39.33 | 8 | |
| Bundled Web Shopping | MemoryArena Bundled Web Shopping | Success Rate (SR)34.67 | 4 |
Showing 9 of 9 rows