Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Continuous improvement of language agents on DS-1000 StreamBench (32 held-out episodes)
Loading...
56.3
Pass@4
Memory w/ MEMOPILOT
48.5
50.525
52.55
54.575
Jun 7, 2026
Pass@4
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@4
Memory w/ MEMOPILOT
Memory Strategy=MEMOPI...
2026.06
56.3
Full History
Memory Strategy=Full H...
2026.06
52.5
No Memory
Memory Strategy=No Mem...
2026.06
50
Memory w/ DeepSeek-V3.2
Memory Strategy=DeepSe...
2026.06
50
Memory w/ Qwen2.5-14B
Memory Strategy=Qwen2....
2026.06
48.8
Feedback
Search any
task
Search any
task