Share your thoughts, 1 month free Claude Pro on usSee more

General Knowledge Question Answering on MMLU-PRO

81.61Accuracy

SMCS

Updated 7d ago

Evaluation Results

Method	Links
SMCS 2025.07		81.61
GPT-4.1(2025-04-14) 2025.07		80.43
Claude-3.5-Sonnet(2024-06-20) 2025.07		78.34
QwQ-32B 2025.07		78.34
GLM-Z1-32B-0414 2025.07		77.84
Qwen3-32B 2025.07		77.76
DeepSeek-R1-Distill-Llama-70B 2025.07		76.09
DeepSeek-R1-Distill-Qwen-32B 2025.07		75.17
HuatuoGPT-o1-72B 2025.07		74.16
GPT-o3-mini(2025-01-31) 2025.07		74
GPT-4o(2024-08-06) 2025.07		73.83
Qwen-2.5-72B-Instruct 2025.07		72.16
EXAONE-Deep-32B 2025.07		70.48
Llama-3.3-70B-Instruct 2025.07		69.87
Claude-3.7-Sonnet(2025-02-19) 2025.07		69.43
Qwen2.5-32b-Instruct 2025.07		69.15
TeleChat2-35B-32K 2025.07		67.98
Llama-3.3-Nemotron-Super-49B-v1 2025.07		67.47
Gemma-3-27b-it 2025.07		65.47
Qwen2.5-Coder-32B-Instruct 2025.07		61.79
DarkForest 2026.05		58.38
Debate 2026.05		55.86
Mixture-of-Agent 2026.05		53.38
Self-Consistency 2026.05		53
Refine 2026.05		52.62
ReConcile 2026.05		45.71
InternLM2.5-20B-Chat 2025.07		44.23
Graph-of-Agent (Max) 2026.05		41.86
Graph-of-Agent (Mean) 2026.05		40.71