Share your thoughts, 1 month free Claude Pro on usSee more

Multi-turn task completion on IntentionGym

1.903Task Completion Score

GRPO + Qwen2.5-8B

Updated 3mo ago

Evaluation Results

Method	Links
GRPO + Qwen2.5-8B 2026.04		1.903
GPT-4o 2026.04		1.898
Qwen2.5-32B 2026.04		1.83
Qwen2.5-8B + PRIME 2026.04		1.825
GRPO + Qwen2.5-4B 2026.04		1.808
Qwen2.5-14B + PRIME 2026.04		1.782
Qwen2.5-4B + PRIME 2026.04		1.772
Qwen2.5-4B 2026.04		1.74
Qwen2.5-8B 2026.04		1.725
Qwen2.5-14B 2026.04		1.7
Gemini-1.5-Flash 2026.04		1.685
Gemini-1.5-Pro 2026.04		1.59
GPT-4o-mini 2026.04		0.25