Share your thoughts, 1 month free Claude Pro on usSee more

Code Reasoning on CRUXEval

68.6Accuracy

Qwen2.5-Math-72B-Instruct

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-Math-72B-Instruct 2025.02		68.6
QwQ-32B-Preview* 2025.02		65.2
Llama-3.1-70B-Instruct* 2025.02		59.6
DataFlow-Code-10K 2025.12		52.9
Self-OSS 2025.12		52.6
DataFlow-Code-5K 2025.12		52.5
DataFlow-Code-1K 2025.12		51
Qwen2.5-Math-7B-S2R-ORL 2025.02		50.9
Code Alpaca-1K 2025.12		50.2
Eurus-2-7B-PRIME 2025.02		50
DataFlow-Code-10K 2025.12		48.8
DataFlow-Code-5K 2025.12		48.6
Qwen2.5-Math-7B-S2R-BI 2025.02		48
DataFlow-Code-1K 2025.12		48
Qwen2.5-14B-Instruct 2025.12		48
Self-OSS 2025.12		46.9
Code Alpaca-1K 2025.12		45.6
Qwen2.5-7B-Instruct 2025.12		44.8
Qwen2.5-Math-7B 2025.02		40.8
OpenMath2-Llama3.1-70B* 2025.02		35.1
Qwen2.5-Math-7B-Instruct 2025.02		28