Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on GPQA (Accuracy, Speedup)

31.03Accuracy

Prophet

Updated 1mo ago

Evaluation Results

Method	Links
Prophet 2025.12		31.03	15.32
Exp-k=16 (7.5, 2.5) 2025.12		30.8	4.47
Cosine (7.5, 0) 2025.12		30.58	15.96
Cosine (7.5, 2.5) 2025.12		30.58	15.93
Linear (7.5, 0) 2025.12		30.58	16.08
Linear (7.5, 2.5) 2025.12		30.58	16.01
Exp-k=2 (7.5, 0) 2025.12		30.58	16.32
Exp-k=16 (7.5, 2.5) 2025.12		30.58	17.16
Baseline 2025.12		30.36	1
Exp-k=2 (7.5, 2.5) 2025.12		30.13	16.18
Exp-k=16 (7.5, 0) 2025.12		29.46	18.64
Exp-k=2 (7.5, 0) 2025.12		29.02	2.85
Prophet 2025.12		28.79	16.45
Exp-k=16 (7.5, 0) 2025.12		28.79	8.67
Exp-k=4 (7.5, 2.5) 2025.12		28.79	2.86
Exp-k=8 (7.5, 2.5) 2025.12		28.57	3.7
Linear (7.5, 0) 2025.12		28.57	2.35
Exp-k=8 (7.5, 0) 2025.12		28.35	5.94
Linear (7.5, 2.5) 2025.12		28.12	1.98
Cosine (7.5, 0) 2025.12		27.9	2.24
Exp-k=4 (7.5, 0) 2025.12		27.46	4.09
Cosine (7.5, 2.5) 2025.12		27.23	1.97
Exp-k=2 (7.5, 2.5) 2025.12		26.34	2.24
Baseline 2025.12		26.12	1