SOTA Mathematical Reasoning on OlympiadBench Math (test) and PapersWithCode

35.9Accuracy

TATA

Updated 4d ago

Evaluation Results

Method	Links
TATA 2025.02		35.9
hybrid 2025.02		35.3
TATA 2025.02		35.3
hybrid 2025.02		34.4
ensemble 2025.02		32.3
hybrid 2025.02		31.7
TATA 2025.02		31.1
ensemble 2025.02		30.8
ensemble 2025.02		30.2
ensemble 2025.02		27.4
TATA 2025.02		26.8
hybrid 2025.02		26.2
TATA 2025.02		24.9
GPT-Select 2025.02		24.6
hybrid 2025.02		24.4
GPT-Select 2025.02		23.3
ensemble 2025.02		23.1
GPT-Select 2025.02		23
DART-Math-DSMath-7B (Prop2Diff) 2024.06		21.7
TATA 2025.02		21.5
DART-Math-DSMath-7B (Uniform) 2024.06		21.3
hybrid 2025.02		21.3
GPT-Select 2025.02		20.6
DART-Math-Llama3-70B (Prop2Diff) 2024.06		20
hybrid 2025.02		19.7
Llama3-70B-VRT 2024.06		19.3
DART-Math-Llama3-70B (Uniform) 2024.06		19.1
DeepSeekMath-7B-VRT 2024.06		19.1
ensemble 2025.02		18.8
TATA 2025.02		18.8
GPT-Select 2025.02		17.3
Llama2-70B-Xwin-Math-V1.1+ 2024.06		16.3
Llama3-70B-MMIQC 2024.06		15.3
ensemble 2025.02		15.3
GPT-Select 2025.02		14.8
DART-Math-Mistral-7B (Prop2Diff) 2024.06		14.7
DART-Math-Llama3-8B (Prop2Diff) 2024.06		14.5
DeepSeekMath-7B-Instruct 2024.06		14.2
GPT-Select 2025.02		13.9
DART-Math-Llama3-8B (Uniform) 2024.06		13.6
DART-Math-Mistral-7B (Uniform) 2024.06		13.2
DeepSeekMath-7B-MMIQC 2024.06		13
Llama3-70B-MetaMath 2024.06		11.6
Llama3-70B-ICL 2024.06		10.8
Llama2-7B-Xwin-Math-V1.1+ 2024.06		10.5
Llama3-8B-MMIQC 2024.06		9.6
Mistral-7B-MMIQC 2024.06		9.4
DeepSeekMath-7B-ICL 2024.06		9.3
Llama3-8B-VRT 2024.06		9.3
Mistral-7B-VRT 2024.06		8.7
TATA 2025.02		8.6
hybrid 2025.02		7.9
Mistral-7B-WizardMath-V1.1 (RL) 2024.06		7.7
ensemble 2025.02		7.7
GPT-Select 2025.02		7.1
Mistral-7B-MetaMath 2024.06		5.9
Llama3-8B-MetaMath 2024.06		5.5
Llama3-8B-ICL 2024.06		4.2
Mistral-7B-ICL 2024.06		3.7