Share your thoughts, 1 month free Claude Pro on usSee more

Scientific Question Answering on GPQA Diamond

84.4Accuracy

Gemini 2.5 Pro

Updated 1mo ago

Evaluation Results

Method	Links
Gemini 2.5 Pro 2026.02		84.4
Interfaze-Beta 2026.02		81.31
Claude Opus 4 2026.02		79.6
Claude Sonnet 4 2026.02		77.7
Claude Sonnet 4 2026.02		68.3
Gemini 2.5 Flash 2026.02		68.3
GPT-5 2026.02		67.3
GPT-4.1(2025-04-14) 2025.07		67.17
GPT-o3-mini(2025-01-31) 2025.07		66.67
GPT-4.1 2026.02		66.3
SMCS 2025.07		66.16
Qwen3-32B 2025.07		64.65
Claude-3.7-Sonnet(2025-02-19) 2025.07		63.64
EXAONE-Deep-32B 2025.07		63.13
QwQ-32B 2025.07		62.63
GLM-Z1-32B-0414 2025.07		62.12
Claude-3.5-Sonnet(2024-06-20) 2025.07		61.62
DeepSeek-R1-Distill-Llama-70B 2025.07		60.6
DeepSeek-V3 2026.02		59.1
ELPO-4B 2026.02		59.1
Qwen-3-30B-A3B 2026.02		58.6
DemyAgent-4B 2026.02		58.5
DeepSeek-R1-Distill-Qwen-32B 2025.07		57.58
Qwen-3-14B 2026.02		56.6
Qwen-3-32B 2026.02		54.7
Base(instruct) 2026.05		54.04
ARPO 2026.02		53
AEPO 2026.02		53
ELPO-7B 2026.02		52.7
GPT-4o(2024-08-06) 2025.07		52.53
HuatuoGPT-o1-72B 2025.07		52.53
GIGPO 2026.02		52.5
GRPO 2026.05		52.02
Qwen3-4B 2026.02		52
DemyAgent 2026.02		52
ToRL 2026.02		51.5
Gemma-3-27b-it 2025.07		50.51
CIR 2026.02		49.5
MESA 2026.05		49.49
Stair-SFT 2026.05		48.98
Llama-3.3-Nemotron-Super-49B-v1 2025.07		48.48
OPD 2026.06		48.1
TIP 2026.05		47.98
Base 2026.05		47.97
Base 2026.05		47.97
Entropy 2026.01		47.85
Gemma-3-27B 2026.02		47.6
ALM 2026.06		47.6
Mistral-3.2-24B 2026.02		47.5
Entropy 2026.05		47.47
TIP 2026.05		47.47
TA-OPD 2026.05		47.47
Stair-DPO 2026.05		47.47
CDM 2026.06		47.4
Pure OPD 2026.05		47.22
Qwen-2.5-72B-Instruct 2025.07		46.97
Llama-3.3-70B-Instruct 2025.07		46.97
SFT 2026.06		46.9
Llama-3.3-70B 2026.02		46.6
ProFit 2026.01		46.53
Entropy 2026.05		46.46
SFT 2026.01		46.02
TA-OPD+Ent. 2026.05		45.7
TA-OPD 2026.05		45.2
SafeX 2026.05		44.44
Qwen3-4B 2026.02		44.3
DFT 2026.01		43.81
Pure OPD 2026.05		42.17
TA-OPD+Ent. 2026.05		42.17
Qwen2.5-Coder-32B-Instruct 2025.07		41.92
Qwen2.5-32b-Instruct 2025.07		40.91
SFT 2026.05		40.4
Vanilla 2026.01		37.69
Gemma-3-12B 2026.02		37.2
OLMo-3.1-32B 2026.02		36
Entropy 2026.01		34.91
InternLM2.5-20B-Chat 2025.07		34.85
TA-OPD 2026.05		34.59
ProFit 2026.01		34.34
SFT 2026.01		34.15
DAPO 2026.02		33.5
TeleChat2-35B-32K 2025.07		33.33
OLMo-3-7B 2026.02		33.2
GRPO 2026.02		32.7
Entropy 2026.05		32.58
TA-OPD+Ent. 2026.05		32.58
DFT 2026.01		31.69
TA-OPD+Ent. 2026.05		31.63
Base 2026.05		31.56
Qwen2.5-7B 2026.02		31.3
Reinforce++ 2026.02		31.3
SFT 2026.05		30.81
Pure OPD 2026.05		30.55
TA-OPD 2026.05		29.59
TIP 2026.05		29.29
Stair-SFT 2026.05		28.28
Base 2026.05		27.81
Pure OPD 2026.05		27.78
TIP 2026.05		27.55
EuroLLM-22B 2026.02		26.8

Showing 100 of 131 rows