Our new X account is live! Follow @wizwand_team for updates

Multitask Language Understanding on MMLU (Accuracy)

89.8Accuracy

Average human expert performance

Updated 2d ago

Evaluation Results

Method	Links
Average human expert performance 2021.12		89.8
Qwen3-30B-A3B 2025.07		77.82
Qwen3-30B-A3B 2025.07		77.82
Qwen3 14B Base 2026.01		77
Qwen3 14B Base 2026.01		76.9
Qwen3 14B 2026.01		76.5
Qwen3 14B 2026.01		76.2
RS 2025.07		74.6
CAST 2025.12		74.27
None (original model) 2025.12		74.19
LinEAS+E2E-DSAS (R) 2025.12		74.16
Qwen2-57B-A14B 2025.07		74.06
Qwen2-57B-A14B 2025.07		74.06
MoNE 2025.07		74.04
LinEAS+DSAS 2025.12		73.81
LinEAS+E2E-DSAS (S) 2025.12		73.61
LinEAS 2025.12		73.59
Qwen3 8B Base 2026.01		73.5
Qwen3 8B Base 2026.01		73.5
CAA 2025.12		73.05
CAA+DSAS 2025.12		73.02
ITI+DSAS 2025.12		72.74
ITI 2025.12		72.72
DIR 2025.12		72.64
ALBM 2025.12		72.55
SK 2025.12		72.33
Base 2025.12		72.31
MC-SMoE 2025.07		72.25
InfoRM 2025.12		72.22
MERA 2025.12		72.06
PoE 2025.12		71.97
MoNE 2025.07		71.64
Qwen3 8B 2026.01		71.6
Qwen3 8B 2026.01		71.4
RS 2025.07		70.99
Qwen3 4B Base 2026.01		70.1
Qwen3 4B Base 2026.01		69.9
MC-SMoE 2025.07		69.46
FLAP 2025.07		69.43
Full 2025.12		68.81
Moonlight 2025.07		67.3
Moonlight 2025.07		67.3
Qwen3 4B 2026.01		67.1
Qwen3 4B 2026.01		67
RevFFN 2025.12		66.7
GaLore 2025.12		66.3
LOMO 2025.12		66.2
SFT + Checkpointing 2025.12		66.1
DoRA 2025.12		65.7
Llama-2 (70B) 2026.01		65.4
Llama-2 (70B) 2026.01		65.4
LoRA 2025.12		65.2
LP 2025.12		65.13
FLAP 2025.07		65.02
(IA)³ 2025.12		65
June 2023 Forecast 2021.12		63.4
Gemma 2024.09		63.2
Base Model 2025.12		62.4
Mistral 2024.09		62.4
ℓ-MoEacc 2026.01		62.23
MoNE 2025.07		62
RS 2025.07		61.37
ℓ-MoEeff 2026.01		61.06
None (original model) 2025.12		60.83
Mistral (7B) 2026.01		60.78
Mistral (7B) 2026.01		60.78
Qwen3 1.7B Base 2026.01		60.4
Qwen3 1.7B Base 2026.01		60.3
Llama-2 (7B) 2026.01		60.04
Llama-2 (7B) 2026.01		60.04
CAA 2025.12		60.02
LinEAS+E2E-DSAS (R) 2025.12		60
Gopher 2021.12		60
ITI+DSAS 2025.12		59.96
CAA+DSAS 2025.12		59.84
ITI 2025.12		59.84
Angular 2025.07		59.75
MC-SMoE 2025.07		59.65
LinEAS+E2E-DSAS (S) 2025.12		59.54
LinEAS+DSAS 2025.12		59.49
MERA 2025.12		59.31
LinEAS 2025.12		59.19
CAST 2025.12		59.09
95BT-8BA Baseline 2026.01		58.95
Phi-2 (2.7B) 2026.01		58.11
Phi-2 (2.7B) 2026.01		58.11
MoE Pathfinder 2025.12		57.66
June 2022 Forecast 2021.12		57.1
MC-SMoE 2025.07		56.3
FLAP 2025.07		55.84
ALBM 2025.12		55.25
MoNE 2025.07		55.23
Qwen3 1.7B 2026.01		55
InfoRM 2025.12		54.97
Deepseek-V2-Lite 2025.07		54.96
Deepseek-V2-Lite 2025.07		54.96
Qwen3 1.7B 2026.01		54.9
PoE 2025.12		54.77
MoNE 2025.07		54.58
Base 2025.12		54.45

Showing 100 of 206 rows