Share your thoughts, 1 month free Claude Pro on usSee more

Multi-turn task completion on TravelGym

57.3Task Completion Score

GRPO + Qwen2.5-8B

Updated 3mo ago

Evaluation Results

Method	Links
GRPO + Qwen2.5-8B 2026.04		57.3
GRPO + Qwen2.5-4B 2026.04		50.9
GPT-4o 2026.04		36.4
Gemini-1.5-Pro 2026.04		34.7
Gemini-1.5-Flash 2026.04		25.5
Qwen2.5-14B + PRIME 2026.04		24.8
Qwen2.5-8B + PRIME 2026.04		21.5
Qwen2.5-14B 2026.04		19.2
Qwen2.5-4B + PRIME 2026.04		18.5
Qwen2.5-32B 2026.04		17.2
Qwen2.5-8B 2026.04		15.8
Qwen2.5-4B 2026.04		14.1
GPT-4o-mini 2026.04		9.8