Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on AIME25 (Pass@k)

66.7Pass@k

Qwen2.5-7B + PPO w/ VERL.

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-7B + PPO w/ VERL. 2025.09		66.7
Qwen2.5-7B 2025.09		60
Qwen2.5-7B + GRPO w/ VERL. 2025.09		60
Qwen2.5-7B + PPO 2025.09		56.7
Qwen2.5-7B + GRPO 2025.09		50
Mathstral-7B-v0.1 + GRPO w/ VERL. 2025.09		50
Mathstral-7B-v0.1 + PPO w/ VERL. 2025.09		46.7
Qwen2.5-3B + GRPO w/ VERL. 2025.09		43.3
Qwen2.5-3B + PPO 2025.09		43.3
Qwen2.5-3B + PPO w/ VERL. 2025.09		43.3
Llama-3.2-3B-Instruct + PPO w/ VERL. 2025.09		40
Qwen2.5-3B 2025.09		40
Qwen2.5-3B + GRPO 2025.09		40
Mathstral-7B-v0.1 + GRPO 2025.09		40
Mathstral-7B-v0.1 + PPO 2025.09		40
Llama-3.2-3B-Instruct + GRPO w/ VERL. 2025.09		36.7
Llama-3.2-3B-Instruct + PPO 2025.09		36.7
Llama-3.1-8B-Instruct 2025.09		36.7
Llama-3.1-8B-Instruct + GRPO 2025.09		36.7
Llama-3.1-8B-Instruct + GRPO w/ VERL. 2025.09		36.7
Llama-3.1-8B-Instruct + PPO 2025.09		36.7
Llama-3.1-8B-Instruct + PPO w/ VERL. 2025.09		36.7
Mathstral-7B-v0.1 2025.09		36.7
Llama-3.2-3B-Instruct 2025.09		30
Llama-3.2-3B-Instruct + GRPO 2025.09		30
Mistral-7B-v0.3 2025.09		16.7
Mistral-7B-v0.3 + GRPO w/ VERL. 2025.09		13.3
Mistral-7B-v0.3 + PPO w/ VERL. 2025.09		13.3
Mistral-7B-v0.3 + GRPO 2025.09		10
Mistral-7B-v0.3 + PPO 2025.09		6.7