Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Counting Task on Spatial and Temporal Simulation Tasks Step-level
Loading...
4.237
Subtask Accuracy
Cortex (full harness)
2.73212
3.12281
3.5135
3.90419
Jul 6, 2026
Subtask Accuracy
Memory Accuracy
Total Score
Updated 18d ago
Evaluation Results
Method
Method
Links
Subtask Accuracy
Memory Accuracy
Total Score
Cortex (full harness)
Level=Step-level
2026.07
4.237
4.504
8.741
Cortex (harness on skills)
Level=Step-level
2026.07
3.527
4.348
7.875
Cortex (baseline)
Level=Step-level
2026.07
3.503
4.173
7.676
Cortex (w/o harness)
Level=Step-level
2026.07
3.435
4.213
7.648
Gemini
Level=Step-level
2026.07
3.135
4.025
7.159
Qwen3-VL-8B-Instruct
Level=Step-level
2026.07
2.948
4.07
7.018
GPT-5
Level=Step-level
2026.07
2.79
3.429
6.22
Feedback
Search any
task
Search any
task