Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Mathematical Reasoning on AIME English 2024 (Pass@1 Accuracy)
Loading...
80
Pass@1 Accuracy
Qwen3 235B A22B
10.632
28.641
46.65
64.659
Jun 30, 2026
Pass@1 Accuracy
Updated 24d ago
Evaluation Results
Method
Method
Links
Pass@1 Accuracy
Qwen3 235B A22B
Context Window=32k
2026.06
80
LuckyStar 111B
Context Window=32k
2026.06
73.7
LuckyStar 111B 4-bit
Quantization=4-bit, Co...
2026.06
72.3
Claude 3.7 Sonnet
Context Window=32k
2026.06
50
Command A
Context Window=32k
2026.06
13.3
GPT-4o (11/20)
Context Window=32k
2026.06
13.3
Feedback
Search any
task
Search any
task