Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Mathematical Reasoning on MATH 500 (Accuracy Avg@8)
Loading...
89.05
Accuracy (Avg@8)
L1-Qwen-7B-Max
53.3572
62.6236
71.89
81.1564
May 28, 2026
Jun 3, 2026
Jun 10, 2026
Jun 16, 2026
Jun 23, 2026
Jun 29, 2026
Jul 6, 2026
Accuracy (Avg@8)
Updated 18d ago
Evaluation Results
Method
Method
Links
Accuracy (Avg@8)
L1-Qwen-7B-Max
# Bits=BF16, Backbone=...
2026.05
89.05
FlexRound+LFQ
# Bits=W4, Backbone=L1...
2026.05
88.4
FlexRound
# Bits=W4, Backbone=L1...
2026.05
87.45
FlexRound+LFQ
# Bits=W3g128, Backbon...
2026.05
86.5
FlexRound
# Bits=W3g128, Backbon...
2026.05
85.35
TOP-D
Student Model=Qwen3-1....
2026.07
77.33
DeepSeek-R1-Distill-Llama-8B
# Bits=BF16, Backbone=...
2026.05
72.53
FlexRound+LFQ
# Bits=W4, Backbone=De...
2026.05
71.95
OPD
Student Model=Qwen3-1....
2026.07
71.13
FlexRound
# Bits=W4, Backbone=De...
2026.05
70.1
FlexRound+LFQ
# Bits=W3g128, Backbon...
2026.05
69.25
FlexRound
# Bits=W3g128, Backbon...
2026.05
67
DAPO
Student Model=Qwen3-1....
2026.07
61.88
Base
Student Model=Qwen3-1....
2026.07
56.8
GRPO
Student Model=Qwen3-1....
2026.07
54.73
Feedback
Search any
task
Search any
task