Share your thoughts, 1 month free Claude Pro on usSee more

Graduate-Level Reasoning on GPQA (Pass@1)

70.18Pass@1

Phi-4-mini + Mistral3-3B

Updated 1mo ago

Evaluation Results

Method	Links
Phi-4-mini + Mistral3-3B 2026.01		70.18
Phi-4-mini + Mistral3-3B + Oracle 2026.01		48.12
EGPSG 2026.06		42.4
Scalable PS 2026.06		40.9
GRPO (MATH) 2026.06		39.9
MH Power Sampling 2026.06		38.9
EGPSL 2026.06		38.4
MH Power Sampling 2026.06		36.4
EGPSL 2026.06		35.9
GRPO (MATH) 2026.06		35.9
APPS (p-only) 2026.06		35.4
EGPSG 2026.06		35.4
GRPO (MATH) 2026.06		35.4
Low-temp 2026.06		35.3
Power-SMC 2026.06		34.9
Scalable PS 2026.06		34.9
Best-of-N 2026.06		34.3
EGPSG 2026.06		34.3
EGPSL 2026.06		33.8
Ministral-3-8B-Reasoning 2026.01		33
APPS (p-only) 2026.06		32.3
MH Power Sampling 2026.06		31.8
Power-SMC 2026.06		31.3
Low-temp 2026.06		30.3
Qwen2.5-7B-Instruct 2026.01		30
Low-temp 2026.06		29.3
Best-of-N 2026.06		28.2
Base 2026.06		27.8
Base 2026.06		27.8
Base 2026.06		27.3
Phi-3-small-8k-Instruct 2026.01		26