Our new X account is live! Follow @wizwand_team for updates

Web Navigation and Automation on WorkArena Held-out Tasks (test)

70Success Rate

Claude-3.5-Sonnet

Updated 4d ago

Evaluation Results

Method	Links
Claude-3.5-Sonnet 2025.07		70
o1-Mini 2025.07		68.6
Llama-3.1-405B-Instruct 2025.07		58.6
GPT-4o 2025.07		55.7
Llama-3.3-70B Instruct (Teacher) 2025.07		44
Llama-3.1-70B-Instruct 2025.07		32.9
Llama-3.1-8B SFT+RL (Ours) 2025.07		28.8
GPT-4o-Mini 2025.07		28.6
Qwen-2.5-72B Instruct (Teacher) 2025.07		27
Llama-3.1-8B SFT (Ours) 2025.07		26.4
Qwen-2.5-7B SFT+RL (Ours) 2025.07		25
Qwen-2.5-7B SFT (Ours) 2025.07		21
Llama-3.1-8B RL (Ours) 2025.07		11.5
Qwen-2.5-7B Instruct (Student) 2025.07		10
Qwen-2.5-7B RL (Ours) 2025.07		7
Llama-3.1-8B Instruct (Student) 2025.07		4.2