Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Agent Continuous Improvement on CoSQL StreamBench (32 held-out episodes)
Loading...
73.5
Pass@4
Memory w/ MEMOPILOT
65.7
67.725
69.75
71.775
Jun 7, 2026
Pass@4
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@4
Memory w/ MEMOPILOT
Memory Strategy=MEMOPI...
2026.06
73.5
Full History
Memory Strategy=Full H...
2026.06
70
No Memory
Memory Strategy=No Mem...
2026.06
69.5
Memory w/ DeepSeek-V3.2
Memory Strategy=DeepSe...
2026.06
67.5
Memory w/ Qwen2.5-14B
Memory Strategy=Qwen2....
2026.06
66
Feedback
Search any
task
Search any
task