Share your thoughts, 1 month free Claude Pro on usSee more

Multi-turn task completion on SearchGym

92.8Task Completion Score

Gemini-1.5-Pro

Updated 3mo ago

Evaluation Results

Method	Links
Gemini-1.5-Pro 2026.04		92.8
Gemini-1.5-Flash 2026.04		92.8
Qwen2.5-14B + PRIME 2026.04		89.2
GRPO + Qwen2.5-8B 2026.04		88.8
GPT-4o 2026.04		88
Qwen2.5-8B + PRIME 2026.04		87.2
GRPO + Qwen2.5-4B 2026.04		86.4
Qwen2.5-4B + PRIME 2026.04		86
Qwen2.5-4B 2026.04		85.6
Qwen2.5-8B 2026.04		80.8
Qwen2.5-32B 2026.04		79.2
Qwen2.5-14B 2026.04		51.2
GPT-4o-mini 2026.04		35.2