Share your thoughts, 1 month free Claude Pro on usSee more

Web Navigation and Automation on WorkArena Held-out Goals (test)

53.8Success Rate

o1-Mini

Updated 1mo ago

Evaluation Results

Method	Links
o1-Mini 2025.07		53.8
Claude-3.5-Sonnet 2025.07		52.5
GPT-4o 2025.07		42.1
Llama-3.1-405B-Instruct 2025.07		39.2
Llama-3.3-70B Instruct (Teacher) 2025.07		36
Llama-3.1-8B SFT+RL (Ours) 2025.07		35.4
Qwen-2.5-72B Instruct (Teacher) 2025.07		33.3
Qwen-2.5-7B SFT+RL (Ours) 2025.07		32.5
Llama-3.1-8B SFT (Ours) 2025.07		28.4
GPT-4o-Mini 2025.07		27.1
Llama-3.1-70B-Instruct 2025.07		25
Qwen-2.5-7B SFT (Ours) 2025.07		25
Llama-3.1-8B Instruct (Student) 2025.07		8.3
Llama-3.1-8B RL (Ours) 2025.07		8
Qwen-2.5-7B Instruct (Student) 2025.07		5.2
Qwen-2.5-7B RL (Ours) 2025.07		4.5