Share your thoughts, 1 month free Claude Pro on usSee more

Multi-turn task completion on TelepathyGym

90.2Task Completion Score

Gemini-1.5-Pro

Updated 3mo ago

Evaluation Results

Method	Links
Gemini-1.5-Pro 2026.04		90.2
GPT-4o 2026.04		85.4
Gemini-1.5-Flash 2026.04		63.4
GRPO + Qwen2.5-4B 2026.04		63.4
Qwen2.5-14B + PRIME 2026.04		63.2
Qwen2.5-14B 2026.04		58.5
Qwen2.5-32B 2026.04		56.1
GRPO + Qwen2.5-8B 2026.04		56.1
Qwen2.5-4B + PRIME 2026.04		55.8
Qwen2.5-8B + PRIME 2026.04		52.4
Qwen2.5-8B 2026.04		51
Qwen2.5-4B 2026.04		48.8
GPT-4o-mini 2026.04		4.9