Share your thoughts, 1 month free Claude Pro on usSee more

Language Understanding on MMLU (MMLU Accuracy)

90MMLU Accuracy

Updated 26d ago

Evaluation Results

Method	Links
GD 2026.04		90
MOC 2026.06		85.26
MOC 2026.06		83.86
MOC 2026.06		83.51
Vanilla MAS 2026.06		82.81
Vanilla MAS 2026.06		82.11
No Defense 2026.06		82
THRD 2026.06		81.7
Vanilla MAS 2026.06		81.4
Qwen3-30B-A3B-Instruct-2507 2026.05		81.12
Single LLM 2026.06		80.7
FlexRound+LFQ 2026.05		80.25
FlexRound 2026.05		80.24
SE-GPT 2026.05		80.2
GPTQ 2026.05		80.15
MetaEvo 2026.05		79.9
MOC 2026.06		79.3
Vanilla MAS 2026.06		78.95
MOC 2026.06		78.95
MOC 2026.06		78.95
Qwen2.5-14B-Instruct 2026.05		78.82
PROACT 2026.06		78.6
Vanilla MAS 2026.06		78.6
MOC 2026.06		78.6
Phi-4 14B Base 2026.06		77.9
Vanilla MAS 2026.06		77.89
Phi-4 14B Chapter I 2026.06		77.6
MetaEvo - w/o CDA 2026.05		77.4
FlexRound 2026.05		77.33
FlexRound+LFQ 2026.05		77.31
Phi-4 14B Chapter II 2026.06		77.2
Vanilla MAS 2026.06		77.19
Qwen3 14B Base 2026.06		77.1
Qwen3-8B 2026.06		76.9
Block-AP+LFQ 2026.05		76.86
Block-AP 2026.05		76.84
Self-Discover 2026.05		76.7
OmniQuant+LFQ 2026.05		76.66
OmniQuant 2026.05		76.64
Base Model 2026.05		76.5
Uniform schedule 2026.06		76.46
MetaEvo - w/o MO 2026.05		76.2
FlexRound+LFQ 2026.05		75.85
FlexRound 2026.05		75.84
Self-Refine 2026.05		75.8
OmniQuant+LFQ 2026.05		75.73
OmniQuant 2026.05		75.62
DreamReasoner-8B 2026.06		75.4
Baseline 2026.06		74.96
FT 2026.06		74.84
Self-ICL 2026.05		74.6
Block-AP 2026.05		74.58
Block-AP+LFQ 2026.05		74.58
Single LLM 2026.06		74.39
Qwen3 14B Chapter I 2026.06		74.3
Qwen3 14B Chapter II 2026.06		74.3
ReQAT 2026.06		74.14
PTQ 2026.06		73.6
Qwen2.5-7B-Instruct 2026.05		73.49
Qwen2.5-7B-Instruct 2026.05		73.49
ReQAT 2026.06		73.14
Qwen3 8B Base 2026.06		73
FlexRound 2026.05		72.5
FlexRound 2026.05		72.5
FlexRound + LFQ 2026.05		72.48
FlexRound+LFQ 2026.05		72.48
No Defense 2026.06		72.4
PTQ 2026.06		72.12
Linear schedule 2026.06		71.96
Qwen2.5-7B 2026.06		71.9
PROACT 2026.06		71.4
Qwen3 8B Chapter I 2026.06		71.3
OmniQuant 2026.05		71
OmniQuant 2026.05		71
OmniQuant + LFQ 2026.05		70.99
OmniQuant+LFQ 2026.05		70.99
THRD 2026.06		70.9
Qwen3 8B Chapter II 2026.06		70.4
Cosine schedule 2026.06		70.34
FlexRound + LFQ 2026.05		70.26
FlexRound+LFQ 2026.05		70.26
FlexRound 2026.05		70.13
FlexRound 2026.05		70.13
Block-AP + LFQ 2026.05		69.94
Block-AP+LFQ 2026.05		69.94
MiMo-7B 2026.06		69.8
Block-AP 2026.05		69.6
Block-AP 2026.05		69.6
Dream-v0-7B 2026.06		69.5
MetaEvo 2026.05		69.1
SE-GPT 2026.05		68.5
OmniQuant 2026.05		68.43
OmniQuant 2026.05		68.43
Llama 3.1 8B Base 2026.06		68.4
OmniQuant + LFQ 2026.05		68.39
OmniQuant+LFQ 2026.05		68.39
SAGE 2026.06		68.3
MetaEvo - w/o CDA 2026.05		67.9
Self-Discover 2026.05		67.4
Self-Refine 2026.05		67.3

Showing 100 of 307 rows