Share your thoughts, 1 month free Claude Pro on usSee more

Multiple-choice Question Answering on GPQA (accuracy)

95.2Accuracy (%)

Pass@100

Updated 1mo ago

Evaluation Results

Method	Links
Pass@100 2026.04		95.2
Pass@100 2026.04		81
BDR-128 2026.04		73.74
BF16 2026.04		73.23
INT4 2026.04		73.23
BDR-16 2026.04		72.9
BDR-64 2026.04		70.87
Logistic 2026.04		69.3
FUSE 2026.04		66.8
Weaver 2026.04		66.4
Naive Bayes 2026.04		60.5
Naive Ensemble 2026.04		60.1
OBV (Oracle Best Verifier) 2026.04		59.1
BDR-64 (K) 2026.04		56.97
BF16 2026.04		56.67
BDR-16 2026.04		54.85
BDR-128 2026.04		54.85
BDR-64 2026.04		54.55
Majority Vote 2026.04		47.4
Weaver 2026.04		47.1
Pass@1 2026.04		42.9
OBV (Oracle Best Verifier) 2026.04		41.9
FUSE 2026.04		40.5
Naive Ensemble 2026.04		37.8
Naive Bayes 2026.04		37.6
Logistic 2026.04		35.9
Majority Vote 2026.04		30.5
DS2-INSTRUCT 2026.03		30.35
DS2-INSTRUCT 2026.03		30.16
Pass@1 2026.04		28.3
Self-Instruct 2026.03		27.18
DS2-INSTRUCT 2026.03		26.35
Zero-Shot 2026.03		26.32
InstructMix 2026.03		26.09
ExploreInstruct 2026.03		25.93
InstructMix 2026.03		23.91
Self-Instruct 2026.03		19.87
ExploreInstruct 2026.03		19.47
ExploreInstruct 2026.03		18.24
InstructMix 2026.03		17.52
Zero-Shot 2026.03		12.51
Zero-Shot 2026.03		8.64
Self-Instruct 2026.03		8.15
INT4 2026.04		0