SOTA Advanced Mathematical Problem Solving on MATH and PapersWithCode

52.3Accuracy

QWEN2-SFT w/ SSO_DPO

Updated 4d ago

Evaluation Results

Method	Links
QWEN2-SFT w/ SSO_DPO 2024.10		52.3
QWEN2-SFT w/ PBAA_DPO 2024.10		50.8
QWEN2-SFT w/ ULTRAFEEDBACK 2024.10		46.7
QWEN2-SFT 2024.10		44.6
QWEN2-INSTRUCT w/ SSO_DPO 2024.10		44.2
QWEN2-INSTRUCT w/ ULTRAFEEDBACK 2024.10		42.9
GPT-4 2023.10		42.5
QWEN2-INSTRUCT w/ PBAA_DPO 2024.10		42.1
QWEN2-INSTRUCT 2024.10		40
SEGO 2023.10		40
Sigma-MoE-Tiny Base 2025.12		36.88
SEGO 2023.10		36.8
PaLM-2 2023.10		34.3
Minerva 2023.10		33.6
Qwen3 0.6B Base 2025.12		32.44
LLAMA3-SFT w/ SSO_DPO 2024.10		30.8
LLAMA3-SFT w/ ULTRAFEEDBACK 2024.10		30.5
LLAMA3-SFT w/ PBAA_DPO 2024.10		30.4
LLAMA3-INSTRUCT w/ ULTRAFEEDBACK 2024.10		29.6
LLAMA3-INSTRUCT w/ SSO_DPO 2024.10		29.6
LLAMA3-SFT 2024.10		29.5
LLAMA3-INSTRUCT w/ PBAA_DPO 2024.10		28.9
LLAMA3-INSTRUCT 2024.10		28.5
Mixtral 8x7B 2024.01		28.4
Gemma-3 4B Base 2025.12		26.1
CodeLLaMA 2023.10		18.1
DeepSeek-V2 Lite 2025.12		17.1
CodeLLaMA 2023.10		14.2
WizardMATH 2023.10		14
LLaMA 2 70B 2024.01		13.8
Mistral 7B 2023.10		13.1
Mistral 7B 2024.01		12.7
WizardMATH 2023.10		10.7
LLaMA 1 33B 2024.01		8.4
LLaMA 2 13B 2023.10		6
LLaMA 2 13B 2024.01		6
Code-Llama 7B 2023.10		5.2
LLAMA 2 7B 2023.10		3.9
LLaMA2 2023.10		3.9
LLaMA 2 7B 2024.01		3.9
LLaMA2 2023.10		2.5