Share your thoughts, 1 month free Claude Pro on usSee more

Multi-task Language Understanding on MMLU (Top-1 agreement)

74.7Top-1 Accuracy

HARP-C

Updated 16d ago

Evaluation Results

Method	Links
HARP-C 2026.06		74.7
Qwen2.5-7B 2026.06		74.2
Uni-Energy 2026.06		66.5
LLaMA 3.1 8B 2026.07		65.25
OURS (GDN) 2026.07		63.22
Uni-Energy 2026.06		63.2
Ind-Energy 2026.06		62.7
Inv-Energy 2026.06		62.7
Ind-Energy 2026.06		62.4
CORE 2026.06		62.2
Dream-7B 2026.06		61.8
HARP-E 2026.06		61.4
HARP-C 2026.06		61.3
APD 2026.06		61.3
STILL (concurrent) 2026.07		61.3
Lizard 2026.07		61.2
APD 2026.06		60.5
Llamba 2026.07		60
Inv-Energy 2026.06		59.4
OURS (GDN) 2026.07		59.17
DAWN 2026.06		58.6
LoLa 2026.07		57.6
LLaDa-8B 2026.06		57.3
CORE 2026.06		56.5
LolCaT 2026.07		54.88
Rand 2026.06		54.1
HARP-E 2026.06		54
Qwen2.5-0.5B 2026.06		47.5
Liger-GLA 2026.07		46.9
SHED-O 2026.06		45.5
CLIMB 2025.04		36.47
Llama-3.2 2025.04		35.4
CLIMB 2025.04		33.28
Qwen2.5 2025.04		33.03
SmolLM 2025.04		32.98
AMD-OLMo 2025.04		31.92
TinyLlama 2025.04		31.6
ADAMS (DENSE all-reduce) 2026.07		22.94
SCAPE (d = 0.01) 2026.07		22.93
SCAPE (d = 0.1) 2026.07		22.91
ADAMW (DENSE all-reduce) 2026.07		22.88
Rand 2026.06		13.8
Full FT 2026.06		13.6
DQ 2026.06		8.3
DSIR 2026.06		2.2
SHED-W 2026.06		0.3