Graduate-level Reasoning on GPQA Diamond (Accuracy)

98.74Accuracy

HEART

Updated 8d ago

Evaluation Results

Method	Links
HEART 2025.09		98.74
HEART 2025.09		90.06
HEART 2025.09		88.05
HEART 2025.09		85.41
Vanilla 2025.09		74.47
CDG 2026.05		72.2
DeepConf-Tail 2026.05		70.7
HEART 2025.09		70.19
DeepConf-Mean 2026.05		68.7
Majority Vote (Self-Consistency) 2026.05		68.2
Vanilla 2025.09		61.48
SPIRAL 2025.06		49.6
DeepSeek-Distill-Qwen-7B 2025.06		48.6
Qwen3-14B 2026.02		44.95
SPIRAL 2025.06		44.6
SFT 2025.06		44.5
Qwen3-14B 2026.02		43.94
SFT 2025.06		41.6
Llama3.1-70B 2026.02		40.91
SPIRAL 2025.06		40.1
Llama3.1-70B 2026.02		38.38
Qwen3-8B-Base 2025.06		38
TemplateRL 2025.05		37.9
SFT 2025.06		37.8
SPIRAL 2025.06		37
SPIRAL 2025.06		33.8
SFT 2025.06		33
SPIRAL 2025.06		32.2
GRPO 2025.05		31.3
Qwen3-4B-Base 2025.06		30.6
OpenReasoner-Zero 2025.05		30.3
Llama-3.1-8B-Instruct 2025.06		30.2
SFT 2025.06		30
Qwen2.5-Math-7B-Instruct 2025.05		28.8
Oat-Zero 2025.05		25.8
SFT 2025.06		24.9
Octothinker-8B-Base 2025.06		22.1
SimpleRL-Zero 2025.05		21.2
PRIME-Zero 2025.05		20.2
Qwen2.5-Math-7B-Base 2025.05		15.2