Our new X account is live! Follow @wizwand_team for updates

Agent Task on WebShop

43.2Success Rate

Gemini 2.5 Pro

Updated 4d ago

Evaluation Results

Method	Links
Gemini 2.5 Pro 2026.02		43.2	27.1
DeepSeek-V3.2 2026.02		41	24.8
DeepSeek-R1 2026.02		38.4	24.1
Gemini 2.5 Flash 2026.02		35	21.6
Llama-3.3-70B-Instruct 2026.02		26.8	17.6
gpt-oss-120b 2026.02		26.2	11.1
GLM-4-32B-0414 2026.02		25.4	17.2
Phi-4-reasoning 2026.02		22.6	14.3
Qwen3-30B-A3B-Thinking 2026.02		21	14.6
Qwen3-30B-A3B-Instruct 2026.02		20.8	13.7
Llama-3.1-8B-Instruct 2026.02		20.8	13.1
Phi-4 2026.02		18.8	12.2
GLM-4-9B-Chat 2026.02		16.4	11.5
Ministral-3-14B-Instruct 2026.02		15.2	5.4
Qwen3-4B-Instruct 2026.02		15	9.6
Qwen3-4B-Thinking 2026.02		12.2	8.2
Mistral-7B-Instruct 2026.02		6.6	4.4