Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Understanding on MMLU (Overall Accuracy)
Loading...
79.9
MMLU Accuracy
SFT
50.884
58.417
65.95
73.483
May 21, 2025
MMLU Accuracy
Updated 13d ago
Evaluation Results
Method
Method
Links
MMLU Accuracy
SFT
Backbone=Qwen2.5-32B
2025.05
79.9
Raw
Backbone=Qwen2.5-32B
2025.05
79.6
Raw
Backbone=Qwen2.5-7B
2025.05
71.3
SFT
Backbone=Qwen2.5-7B
2025.05
71.3
GRPO
Backbone=Qwen2.5-7B
2025.05
71.3
SFT
Backbone=Llama3.1-8B
2025.05
61.4
GRPO
Backbone=Llama3.1-8B
2025.05
61.1
Raw
Backbone=Llama3.1-8B
2025.05
60.4
Raw
Backbone=Llama3.2-3B
2025.05
52.7
SFT
Backbone=Llama3.2-3B
2025.05
52.1
GRPO
Backbone=Llama3.2-3B
2025.05
52
Feedback
Search any
task
Search any
task
