Share your thoughts, 1 month free Claude Pro on usSee more

Inference Runtime on GPQA Diamond (Scientific Reasoning)

1Total Inference Runtime (s)

RL +length penalty

Updated 12d ago

Evaluation Results

Method	Links
RL +length penalty 2026.04		1
S-GRPO 2026.04		1
RL +length penalty 2026.04		1
DAST 2026.04		2
RL +length penalty 2026.04		2
S-GRPO 2026.04		2
RED 2026.04		2
DAST 2026.04		2
RED 2026.04		2
DAST 2026.04		2
S-GRPO 2026.04		2
RED 2026.04		2
Think or Not 2026.04		3
RED 2026.04		3
Vanilla 2026.04		4
Think or Not 2026.04		4
DAST 2026.04		4
Vanilla 2026.04		4
Think or Not 2026.04		4
RED 2026.04		4
Vanilla 2026.04		4
Think or Not 2026.04		4
DAST 2026.04		5
RL +length penalty 2026.04		5
S-GRPO 2026.04		5
Vanilla 2026.04		6
RL +length penalty 2026.04		6
S-GRPO 2026.04		6
RED 2026.04		6
Vanilla 2026.04		7
Think or Not 2026.04		8
DAST 2026.04		8
RL +length penalty 2026.04		8
S-GRPO 2026.04		8
Vanilla 2026.04		10
Think or Not 2026.04		11