Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Spatial Reasoning on bAbI Task 1 qa1 50 samples
Loading...
19
Accuracy
CoS
9.64
12.07
14.5
16.93
Feb 2, 2026
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
CoS
feature=symbolic state...
2026.02
19
Self-Consistency
temperature=0.7, k=5
2026.02
11.5
Direct
temperature=0
2026.02
11
Chain-of-Thought
temperature=0
2026.02
10
Structured CoT
temperature=0
2026.02
10
Feedback
Search any
task
Search any
task
