Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on MATH500 (Pass@k)

91.4Pass@k

Qwen2.5-7B + GRPO w/ VERL.

Updated 5d ago

Evaluation Results

Method	Links
Qwen2.5-7B + GRPO w/ VERL. 2025.09		91.4
Qwen2.5-7B + PPO w/ VERL. 2025.09		91.4
Qwen2.5-7B + PPO 2025.09		91.2
Qwen2.5-7B + GRPO 2025.09		90.8
Qwen2.5-7B 2025.09		90.6
Qwen2.5-3B + PPO w/ VERL. 2025.09		88.2
Qwen2.5-3B + PPO 2025.09		87.8
Qwen2.5-3B + GRPO w/ VERL. 2025.09		87.6
Mathstral-7B-v0.1 + GRPO w/ VERL. 2025.09		87
Qwen2.5-3B + GRPO 2025.09		86.6
Qwen2.5-3B 2025.09		86
Mathstral-7B-v0.1 + GRPO 2025.09		84.8
Mathstral-7B-v0.1 + PPO w/ VERL. 2025.09		84.8
Llama-3.1-8B-Instruct + GRPO 2025.09		83.4
Llama-3.1-8B-Instruct + GRPO w/ VERL. 2025.09		83.4
Llama-3.2-3B-Instruct + PPO w/ VERL. 2025.09		82.4
Llama-3.1-8B-Instruct + PPO w/ VERL. 2025.09		82.4
Mathstral-7B-v0.1 + PPO 2025.09		82.4
Llama-3.2-3B-Instruct + PPO 2025.09		82.2
Llama-3.2-3B-Instruct + GRPO w/ VERL. 2025.09		80.6
Mathstral-7B-v0.1 2025.09		80.4
Llama-3.2-3B-Instruct + GRPO 2025.09		80.2
Llama-3.2-3B-Instruct 2025.09		79.8
Llama-3.1-8B-Instruct 2025.09		79.8
Llama-3.1-8B-Instruct + PPO 2025.09		79.2
Mistral-7B-v0.3 2025.09		36
Mistral-7B-v0.3 + GRPO w/ VERL. 2025.09		34.4
Mistral-7B-v0.3 + GRPO 2025.09		33
Mistral-7B-v0.3 + PPO 2025.09		21.8
Mistral-7B-v0.3 + PPO w/ VERL. 2025.09		19.2