Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on MMLU-Pro

92.86Accuracy

Agent Q-Mix

Updated 5d ago

Evaluation Results

Method	Links
Agent Q-Mix 2026.04		92.86
Lobster 2026.04		91.43
LangGraph 2026.04		91.43
Gemini-3.0 Pro 2026.01		90.1
Agent Framework 2026.04		90
TopoDIM 2026.04		88.57
AutoGen 2026.04		88.57
Agent Q-Mix 2026.04		88.57
Claude Sonnet 4.5 2026.01		88.2
GPT-5 High 2026.01		87.5
Lobster 2026.04		87.14
GTD 2026.04		87.14
Qwen3.5-27B 2026.04		86.1
GTD 2026.04		85.71
MaAS 2026.04		85.71
TopoDIM 2026.04		85.71
DeepSeek-V3.2 Thinking 2026.01		85
MiMo-V2-Flash 2026.01		84.9
Kimi-K2 Thinking 2026.01		84.6
G-Designer 2026.04		84.29
MaAS 2026.04		84.29
K-EXAONE-236B-A23B 2026.04		83.8
Qwen3-VL-235B-A22B 2026.04		83.8
EXAONE 4.5 33B 2026.04		83.3
GPT-5 mini 2026.04		83.3
AgentDropout 2026.04		82.86
LLM-Debate 2026.04		82.86
GPTSwarm 2026.04		82.86
GPTSwarm 2026.04		81.43
AutoGen 2026.04		81.43
Base (direct) 2026.04		81.43
QwQ-32B 2025.09		81.4
QwQ-32B-CodeGym 2025.09		81.4
Agent Framework 2026.04		80
LLM-Debate 2026.04		78.57
G-Designer 2026.04		78.57
FP16 2025.11		78.1
QTIP 2025.11		77.9
ParoQuant 2025.11		77.5
AWQ 2025.11		77.2
E-QAT 2025.11		76.5
FP16 2025.11		74.6
Base (direct) 2026.04		74.29
AgentDropout 2026.04		74.29
ParoQuant 2025.11		74.1
QTIP 2025.11		74
AWQ 2025.11		73.5
E-QAT 2025.11		73.4
Qwen2.5-72B-CodeGym 2025.09		73.3
T3S 2026.01		73.09
T3S 2026.01		72.88
T3S 2026.01		72.65
T3S 2026.01		72.65
Qwen2.5-72B-Instruct 2025.09		72.2
SFT 2026.01		71.73
SFT 2026.01		71.48
Base 2026.01		71.42
SFT 2026.01		71.21
Qwen2.5-32B-CodeGym 2025.09		71.2
FP16 2025.11		71
ParoQuant 2025.11		70.1
Qwen2.5-32B-Instruct 2025.09		70
SFT 2026.01		69.92
QTIP 2025.11		69.7
AWQ 2025.11		68.2
E-QAT 2025.11		67.7
Qwen2.5-14B-CodeGym 2025.09		67.2
Qwen2.5-14B-Instruct 2025.09		66.3
FP16 2025.11		58.8
SPIRAL 2025.06		58.5
Qwen2.5-7B-Instruct 2025.09		57.9
Qwen2.5-7B-CodeGym 2025.09		57.6
Qwen2.5-7B-Instruct 2026.02		57.4
QTIP 2025.11		57.4
ParoQuant 2025.11		57.1
AWQ 2025.11		56
E-QAT 2025.11		55.6
LGT 2025.11		51.07
SPIRAL 2025.06		50.4
LGT 2025.11		49.82
Llama-3.1-8B-Instruct 2025.06		49.1
LPT 2025.11		48.74
Qwen3-4B-Base 2025.06		47.2
Qwen2.5-Omni-7B 2025.11		47
LangGraph 2026.04		45.86
Virgo 2025.11		39.21
KEEL 2026.01		35.6
s1.1-7B 2026.02		28.7
Pre-LN 2026.01		26.6
DGR SFT 2026.02		20.1
DGR SFT 2026.02		18.9
Vanilla SFT 2026.02		11.5
Vanilla SFT 2026.02		11
DGR SFT 2026.02		7.6
Vanilla SFT 2026.02		4.3