Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on MMLU (Accuracy, Avg, ΔScore)
Loading...
77.84
Accuracy
Qwen3-30BA3B
-2.558968
18.313841
39.18665
60.059459
Oct 8, 2025
Nov 3, 2025
Nov 29, 2025
Dec 25, 2025
Jan 20, 2026
Feb 15, 2026
Mar 13, 2026
Accuracy
Avg Score
Δ Score
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy
Avg Score
Δ Score
Qwen3-30BA3B
Model=Qwen3-30BA3B, Ar...
2025.10
77.84
-
-
NHA-Qwen3-30BA3B
Model=NHA-Qwen3-30BA3B...
2025.10
75.51
-
-
R1-Oracle
Backbone=Qwen2.5-3B-In...
2026.03
0.7222
0.7912
0
MemReward
Backbone=Qwen2.5-3B-In...
2026.03
0.72
0.7702
-2.1
R1-p
Backbone=Qwen2.5-3B-In...
2026.03
0.7178
0.7567
-3.45
R1-Oracle
Backbone=Qwen2.5-1.5B-...
2026.03
0.6644
0.7047
0
MemReward
Backbone=Qwen2.5-1.5B-...
2026.03
0.5467
0.681
-2.37
R1-p
Backbone=Qwen2.5-1.5B-...
2026.03
0.5333
0.6272
-7.75
Feedback
Search any
task
Search any
task