Share your thoughts, 1 month free Claude Pro on usSee more

Multitask Language Understanding on MMLU-Pro

89.31Accuracy

Gemini-3-Pro-Preview

Updated 4d ago

Evaluation Results

Method	Links
Gemini-3-Pro-Preview 2026.05		89.31
GPT-5 (High) 2026.02		87.1
Gemini 3-Pro 2026.02		86.88
GPT-5-2025-08-07 2026.05		86.21
Gemini 2.5 Pro 2026.02		86.2
Gemini 2.5-Pro 2026.02		86.2
Kimi-K2.5 2026.05		86.2
Claude Opus 4 2026.02		86
Gemini-2.5-Pro 2026.05		85.85
DeepSeek-V3.2 2026.05		85.81
JT 2026.05		85.57
DeepSeek-V3.2-Speciale 2026.05		85.45
GLM-5 2026.05		85.23
DS V3.2-Thinking 2026.02		85
Kimi-K2 2026.05		84.34
TeleChat 2026.05		84.09
GLM-4-7 2026.05		83.97
ERNIE 5.0 2026.02		83.8
Claude Sonnet 4 2026.02		83.7
Claude Sonnet 4 2026.02		83.7
Interfaze-Beta 2026.02		83.6
DeepSeek-R1-0528 2026.05		83.52
Step-3.5-Flash 2026.05		83.46
Qwen3 2026.05		83.46
DeepSeek-Chat-V3-0324 2026.05		83.27
Mimo-V2-Flash 2026.05		83.11
doubao-seed-1.6 2026.05		83.11
o3-2025-04-16 2026.05		83.02
Claude Sonnet 4 2026.05		83.02
GLM-4.6 2026.05		82.95
GLM-4.5 2026.05		82.72
Finix-P1-32B 2026.05		82.65
o4-mini-2025-04-16 2026.05		82.42
Qwen3-Next 2026.05		82.02
MiniMax-M2.5 2026.05		81.74
MiniMax-M2 2026.05		81.6
Qwen3-Next 2026.05		81.31
GPT-4.1-20250414 2026.05		81.02
LongCat-Flash-Chat 2026.05		80.95
Gemini 2.5 Flash 2026.02		80.9
Qwen3 2026.05		80.89
GLM-4.5-Air 2026.05		80.68
Seed-OSS-36B 2026.05		80.62
GPT-4.1 2026.02		80.6
GPT-5 2026.02		80.6
gpt-oss-120b 2026.05		79.68
Llama4-Maverick 2026.05		79.56
Qwen3 2026.05		79.46
o3-mini-2025-04-16 2026.05		79.24
Qwen3 2026.05		79.22
ERNIE-4.5 2026.05		78.72
Kimi-K2 2026.05		78.39
GLM-Z1-32B-0414 2026.05		77.42
Claude 3.5 Sonnet 2024.07		77
DCPO 2026.01		76.1
Trinity Large Preview 2026.02		75.25
GPT-5-nano-2025-08-07 2026.05		75.02
GPT-4o 2024.07		74
QwQ-32B 2026.05		73.94
Qwen3 2026.05		73.93
Hunyuan-A13B 2026.05		73.84
GLM-4-32B-0414 2026.05		73.47
Llama 3 405B 2024.07		73.3
gpt-oss-20b 2026.05		72.84
Qwen3-4B 2026.05		72.78
Qwen3-4B 2026.01		72.67
MiniCPM-Sala 2026.05		71.99
ERNIE-4.5 2026.05		70.79
GPT-5-mini-2025-08-07 2026.05		70.24
Qwen3-4B-Instruct 2026.04		69.6
Gemma-3-27B-it 2026.05		67.84
Spurious 2026.05		67.12
RTT-AON 2026.04		66.76
GCWM 2026.05		66.5
Llama 3 70B 2024.07		66.4
GCWM 2026.05		66.2
GPT-4o 2026.01		66
Gemma 2 27B 2026.02		65.15
TA 2026.05		64.9
GPT-4 (0125) 2024.07		64.8
GCWM 2026.05		63.9
GSPO + LIE 2026.02		63.8
DeepSeek-V3.2 2026.01		63.69
TIES 2026.05		63.6
Llama 70B 2026.02		63.14
Qwen3-4B 2026.05		63.03
GRPO w/Clip-higher + LIE 2026.02		63
SDPO 2026.01		62.9
GRPO w/Clip-higher 2026.02		62.8
Nemotron 4 340B 2024.07		62.7
Base 2026.01		62.5
GRPO 2026.01		62.3
Spurious Universal 2026.05		61.94
SFT on self-teacher 2026.01		61.9
GSPO 2026.02		61.5
Mistral 24B 2026.02		60.82
TA 2026.05		60.8
GRPO + LIE 2026.02		60.4
TIES 2026.05		60.4
PromptWizard 2026.05		60.17

Showing 100 of 248 rows