Share your thoughts, 1 month free Claude Pro on usSee more

Massive Multitask Language Understanding on MMLU-Pro (Accuracy)

88.3Accuracy (MMLU-Pro)

Qwen-3.5

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-3.5 2026.06		88.3
Kimi-K2.6 2026.06		88.1
DS-v4-Pro 2026.06		87.5
Nemotron 3 Ultra 2026.06		86.8
DS-v4-Flash 2026.06		86.4
GLM-5.1 2026.06		85.9
Hybrid-LoRA 2026.05		83.8
Hybrid-LoRA 2026.05		83.1
AutoLoRA 2026.05		81.9
MiniMax-2.7 2026.06		81.9
MIPROv2 2025.11		80.6
AutoLoRA 2026.05		80.3
BFRS 2025.11		80.1
Zero-Shot CoT 2025.11		79.7
Qwen3-30B-A3B 2026.03		78.6
Zero-Shot Predict 2025.11		78.4
Zero-Shot Predict 2025.11		77.7
Qwen3-14B 2026.03		77.3
HELM Baseline 2025.11		77.1
BFRS 2025.11		76.5
HELM Baseline 2025.11		76.3
Zero-Shot CoT 2025.11		76.2
MIPROv2 2025.11		76.1
BFRS 2025.11		75.4
Zero-Shot CoT 2025.11		75.3
MIPROv2 2025.11		75.3
Full-FT (ref.) 2026.05		73.4
Hybrid-LoRA 2026.05		72.9
Hybrid-LoRA 2026.05		71.9
Full-FT (ref.) 2026.05		71.8
BFRS 2025.11		71.1
AutoLoRA 2026.05		71.1
Zero-Shot Predict 2025.11		70.3
AutoLoRA 2026.05		69.3
MIPROv2 2025.11		68.7
BFRS 2025.11		68.6
MIPROv2 2025.11		68.6
Zero-Shot CoT 2025.11		68.5
BFRS 2025.11		68.5
Zero-Shot CoT 2025.11		67.6
OWPO 2026.05		67.41
Zero-Shot CoT 2025.11		66.2
HELM Baseline 2025.11		66.1
MOPD 2026.05		65.99
OPD 2026.05		65.91
Sym-DAPO 2026.05		65.58
DAPO 2026.05		65.29
GRPO 2026.05		64.71
HELM Baseline 2025.11		64.7
Gpt-oss-20b-high 2026.03		63.1
Zero-Shot Predict 2025.11		62.7
HELM Baseline 2025.11		62.2
Zero-Shot Predict 2025.11		60.7
EngGPT2-16B-A3B 2026.03		57.3
Hybrid-LoRA 2026.05		56.9
Full-FT (ref.) 2026.05		56.8
MIPROv2 2025.11		56.5
gemma-3-12b-it 2026.03		56
Full-FT (ref.) 2026.05		55.6
Hybrid-LoRA 2026.05		54.9
AutoLoRA 2026.05		54.9
LoRA-Drop 2026.05		54.7
AdaLoRA 2026.05		53.5
LoRA-Drop 2026.05		53.2
LoRA-FFN 2026.05		53.1
AutoLoRA 2026.05		52.1
AdaLoRA 2026.05		50.5
Llama-3.1-8B-Instruct 2026.03		49.2
gemma-2-9b-it 2026.03		48.2
Moonlight-16B-A3B-Instruct 2026.03		47.1
Full-FT 2026.05		46.9
OWPO 2026.05		46.85
Ours (+GDPO) 2026.05		45.2
Ours (+SFT) 2026.05		45.14
STAIR 2026.05		44.92
HELM Baseline 2025.11		44.9
DPO 2026.05		44.52
Original 2026.05		44.25
DAPO 2026.05		44.09
Shallow-Align 2026.05		43.9
float16 2024.12		43.86
Self-Critique 2026.05		43.85
MOPD 2026.05		43.81
MixLLM 2024.12		43.8
OPD 2026.05		43.34
MixLLM 2024.12		43.26
SmoothQuant 2024.12		42.98
Sym-DAPO 2026.05		42.93
QuaRot 2024.12		42.45
QServe 2024.12		41.72
Zero-Shot Predict 2025.11		41.7
SFT 2026.05		41.59
MixLLM 2024.12		41.49
CoT 2026.05		40.4
GRPO 2026.05		36.94
MixLLM 2024.12		35.54
float16 2024.12		35.52
SmoothQuant 2024.12		35.04
MixLLM 2024.12		34.53
QuaRot 2024.12		34.4

Showing 100 of 122 rows