Share your thoughts, 1 month free Claude Pro on usSee more

Multi-task Language Understanding on MMLU (MMLU Acc)

82.67MMLU Accuracy

CascadeDebate

Updated 3d ago

Evaluation Results

Method	Links
CascadeDebate 2026.04		82.67
CascadeDebate 2026.04		78
Standard Cascade 2026.04		73.2
Standard Cascade 2026.04		67.7
S_multi(M_large) 2026.04		67.11
S_single(M_large) 2026.04		65
S_multi(M_large) 2026.04		64.78
S_single(M_large) 2026.04		62.44
S_single(M_base) 2026.04		58.78
S_multi(M_base) 2026.04		58.44
LoRA 2026.04		54.5
SOLAR 2026.04		54.5
NOLA 2026.04		51.8
Dense 2025.06		48.6
S_multi(M_base) 2026.04		47.56
MiCRo 2025.06		45.4
MoB 2025.06		45.2
S_single(M_base) 2026.04		44.22
RegMix 2025.07		35.03
DataAgent_SFT 2025.07		34.65
Base Model 2025.07		34.5
Base Model 2025.07		34.47
DataAgent_RL 2025.07		34.27
Base Model 2025.07		34.22
DataAgent_RL 2025.07		34.06
DataAgent_SFT 2025.07		34.06
DataAgent_SFT 2025.07		33.81
DataAgent_RL 2025.07		33.78
DBL 2025.07		33.2
RegMix 2025.07		32.83
DBL 2025.07		31.27
MiCRo 2025.06		31.2
Base Model 2025.07		30.74
DataAgent_SFT 2025.07		30.66
RegMix 2025.07		30.42
LoRA 2026.04		30.1
DataAgent_RL 2025.07		30
Dense 2025.06		29.7
RegMix 2025.07		29.37
DBL 2025.07		29
SOLAR 2026.04		28.3
Naive Training 2025.07		27.25
Naive Training 2025.07		27.11
MoB 2025.06		27.1
Naive Training 2025.07		27.06
MoB 2025.06		26.8
Dense 2025.06		26.4
MiCRo 2025.06		26
NOLA 2026.04		25.9
Naive Training 2025.07		25.8
MiCRo 2025.06		22.5
MoB 2025.06		21.9
Dense 2025.06		21.5
LIRA* 2026.04		3.1
GD 2026.04		0.9
LIRA* 2026.04		0.1
RMU 2026.04		0.1
RMU 2026.04		0
GD 2026.04		-1.8