Share your thoughts, 1 month free Claude Pro on usSee more

General Knowledge on MMLU-Pro 0-shot

44.4MMLU-Pro Score (0-shot)

MARS-7B

Updated 9d ago

Evaluation Results

Method	Links
MARS-7B 2026.04		44.4
AR SFT 2026.04		43.9
MARS-0.5B 2026.04		12.4
MARS-0.5B w/o SFT loss 2026.04		12.3
AR SFT (5 ep) 2026.04		11.9
Base (no fine-tune) 2026.04		10.5
AR SFT (10 ep) 2026.04		9.3
Base (no fine-tune) 2026.04		2.4
Block Diffusion 2026.04		2