Share your thoughts, 1 month free Claude Pro on usSee more

Multi-turn task completion on TauGym

21Task Completion Score

GRPO + Qwen2.5-8B

Updated 3mo ago

Evaluation Results

Method	Links
GRPO + Qwen2.5-8B 2026.04		21
GPT-4o-mini 2026.04		20.6
GRPO + Qwen2.5-4B 2026.04		20
Gemini-1.5-Pro 2026.04		19.4
Qwen2.5-14B + PRIME 2026.04		12.4
Gemini-1.5-Flash 2026.04		12.1
Qwen2.5-14B 2026.04		10.3
Qwen2.5-8B + PRIME 2026.04		7.2
Qwen2.5-4B + PRIME 2026.04		5.8
Qwen2.5-8B 2026.04		4.8
Qwen2.5-4B 2026.04		3.6
GPT-4o 2026.04		3
Qwen2.5-32B 2026.04		0