Share your thoughts, 1 month free Claude Pro on usSee more

Multi-turn task completion on FunctionGym

42.3Task Completion Score

GRPO + Qwen2.5-8B

Updated 3mo ago

Evaluation Results

Method	Links
GRPO + Qwen2.5-8B 2026.04		42.3
Gemini-1.5-Pro 2026.04		41
GRPO + Qwen2.5-4B 2026.04		39.7
Gemini-1.5-Flash 2026.04		32.1
Qwen2.5-14B + PRIME 2026.04		29.8
GPT-4o 2026.04		28.2
Qwen2.5-8B + PRIME 2026.04		27.8
Qwen2.5-4B + PRIME 2026.04		24.5
Qwen2.5-14B 2026.04		16.7
GPT-4o-mini 2026.04		15.4
Qwen2.5-32B 2026.04		15.4
Qwen2.5-8B 2026.04		9.5
Qwen2.5-4B 2026.04		7.7