Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on Crafter four-actor rollout robustness
Loading...
59.3
Average Exact Match (EM)
S3Mem
31.168
38.4715
45.775
53.0785
Apr 10, 2026
Average Exact Match (EM)
Average Token Count
Minimum Exact Match (EM)
Maximum Exact Match (EM)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Average Exact Match (EM)
Average Token Count
Minimum Exact Match (EM)
Maximum Exact Match (EM)
S3Mem
2026.04
59.3
148.64
54.4
61.82
Graph-NoReader
2026.04
57.42
1,920.48
53.57
60.68
LightMem-adapted
2026.04
56.37
111.94
53.85
61.98
A-MEM-inspired
2026.04
52.7
142.53
46.43
58.4
MemoryOS-adapted
2026.04
51.23
143.92
48.35
53.72
Vanilla RAG
2026.04
46.43
788.46
42.58
49.57
No-Memory
2026.04
32.25
462.73
31.05
32.78
Feedback
Search any
task
Search any
task