Share your thoughts, 1 month free Claude Pro on usSee more

Web Task Completion on MiniWoB++ Held-out Goals (test)

70.5Success Rate

Claude-3.5-Sonnet

Updated 1mo ago

Evaluation Results

Method	Links
Claude-3.5-Sonnet 2025.07		70.5
o1-Mini 2025.07		69.7
Llama-3.1-8B SFT+RL (Ours) 2025.07		67.2
Llama-3.1-405B-Instruct 2025.07		65.9
GPT-4o 2025.07		65.7
Qwen-2.5-7B SFT+RL (Ours) 2025.07		65
Llama-3.3-70B Instruct (Teacher) 2025.07		63.2
Qwen-2.5-72B Instruct (Teacher) 2025.07		61
Llama-3.1-70B-Instruct 2025.07		57
Qwen-2.5-7B SFT (Ours) 2025.07		57
GPT-4o-Mini 2025.07		56.2
Llama-3.1-8B SFT (Ours) 2025.07		55.2
Qwen-2.5-7B RL (Ours) 2025.07		52.5
Llama-3.1-8B RL (Ours) 2025.07		43.5
Qwen-2.5-7B Instruct (Student) 2025.07		32.8
Llama-3.1-8B Instruct (Student) 2025.07		29.5