Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
General Knowledge on MMLU-Pro 0-shot
Loading...
44.4
MMLU-Pro Score (0-shot)
MARS-7B
0.304
11.752
23.2
34.648
Apr 8, 2026
MMLU-Pro Score (0-shot)
Updated 9d ago
Evaluation Results
Method
Method
Links
MMLU-Pro Score (0-shot)
MARS-7B
Model Scale=7B, Block...
2026.04
44.4
AR SFT
Model Scale=7B, One-to...
2026.04
43.9
MARS-0.5B
Model Scale=0.5B, Bloc...
2026.04
12.4
MARS-0.5B w/o SFT loss
Model Scale=0.5B, Bloc...
2026.04
12.3
AR SFT (5 ep)
Model Scale=0.5B, Trai...
2026.04
11.9
Base (no fine-tune)
Model Scale=7B, One-to...
2026.04
10.5
AR SFT (10 ep)
Model Scale=0.5B, Trai...
2026.04
9.3
Base (no fine-tune)
Model Scale=0.5B, One-...
2026.04
2.4
Block Diffusion
Model Scale=0.5B, Bloc...
2026.04
2
Feedback
Search any
task
Search any
task