Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on GSM8K (Accuracy & Speedup)

74.66Accuracy

Baseline

Updated 3mo ago

Evaluation Results

Method	Links
Baseline 2025.12		74.66	1
Exp-k=2 (7.5, 2.5) 2025.12		74.51	1.53
Exp-k=2 (7.5, 0) 2025.12		74.35	1.67
Cosine (7.5, 2.5) 2025.12		74.27	1.28
Linear (7.5, 2.5) 2025.12		74.27	1.27
Cosine (7.5, 0) 2025.12		74.11	1.61
Linear (7.5, 0) 2025.12		74.11	1.49
Exp-k=16 (7.5, 0) 2025.12		73.8	5
Exp-k=16 (7.5, 2.5) 2025.12		72.61	2.1
Prophet 2025.12		66.54	1.02