Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Reasoning on ARC Hard
Loading...
1.22
Accuracy Improvement
N-GRAM SAMPLING
-0.0384
0.2883
0.615
0.9417
Jun 27, 2025
Accuracy Improvement
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy Improvement
N-GRAM SAMPLING
Number of Parameters=350M
2025.06
1.22
N-GRAM SAMPLING
Number of Parameters=1.5B
2025.06
0.82
N-GRAM SAMPLING
Number of Parameters=3B
2025.06
0.72
PPL SAMPLING
Number of Parameters=350M
2025.06
0.6
AUTOMIXER-350M
Number of Parameters=350M
2025.06
0.55
PPL SAMPLING
Number of Parameters=1.5B
2025.06
0.52
AUTOMIXER-350M
Number of Parameters=1.5B
2025.06
0.39
AUTOMIXER-350M
Number of Parameters=3B
2025.06
0.34
PPL SAMPLING
Number of Parameters=3B
2025.06
0.32
AUTOMIXER-75M
Number of Parameters=350M
2025.06
0.12
AUTOMIXER-75M
Number of Parameters=1.5B
2025.06
0.01
AUTOMIXER-75M
Number of Parameters=3B
2025.06
0.01
Feedback
Search any
task
Search any
task