Share your thoughts, 1 month free Claude Pro on usSee more

General Reasoning on GPQA diamond

75.18Avg@8 Accuracy

ROSA (+LM + M)

Updated 1mo ago

Evaluation Results

Method	Links
ROSA (+LM + M) 2025.09		75.18
ROSA (+HS + R) 2025.09		70.27
ROSA (+LM + R) 2025.09		69.11
ROSA (+LM + M) 2025.09		45.83
ROSA (+HS + R) 2025.09		43.16
ROSA (+LM + R) 2025.09		42.24
Baseline 2025.09		41.16
GPS 2026.02		30.4
PCL 2026.02		28.5
Uniform Sampling 2026.02		27.5
MoPPS 2026.02		27.5
Dynamic Sampling (Oracle) 2026.02		26.8
GRESO 2026.02		26.4
Baseline 2025.09		26.14
ROSA (+LM + M) 2025.09		25.36
GRESO 2026.02		25
MoPPS 2026.02		23.4
DeepSeek-R1-Distill-1.5B 2026.02		22.8
PCL 2026.02		22.4
ROSA (+HS + R) 2025.09		22.23
GPS 2026.02		22.2
ROSA (+LM + R) 2025.09		21.14
Dynamic Sampling (Oracle) 2026.02		19.6
DeepSeek-R1-Distill-7B 2026.02		19.2
Baseline 2025.09		19.03
Uniform Sampling 2026.02		17.3
ROSA (+LM + M) 2025.09		13.16
Baseline 2025.09		12.2
ROSA (+HS + R) 2025.09		10.54
ROSA (+LM + M) 2025.09		10.27
ROSA (+LM + R) 2025.09		9.09
ROSA (+HS + R) 2025.09		8.53
ROSA (+LM + R) 2025.09		7.07
Baseline 2025.09		3.54