Share your thoughts, 1 month free Claude Pro on usSee more

Legal Reasoning on LEXam

23.4Pass@1 Accuracy

Qwen2.5-7B + PPO w/ VERL.

Updated 5d ago

Evaluation Results

Method	Links
Qwen2.5-7B + PPO w/ VERL. 2025.09		23.4
Qwen2.5-7B + GRPO w/ VERL. 2025.09		23
Qwen2.5-7B + PPO 2025.09		22.8
Mathstral-7B-v0.1 + GRPO w/ VERL. 2025.09		22.6
Mathstral-7B-v0.1 + GRPO 2025.09		22.4
Qwen2.5-7B + GRPO 2025.09		22
Mathstral-7B-v0.1 + PPO w/ VERL. 2025.09		21.4
Qwen2.5-7B 2025.09		21.1
Mathstral-7B-v0.1 2025.09		19.6
Mathstral-7B-v0.1 + PPO 2025.09		17.3