Share your thoughts, 1 month free Claude Pro on usSee more

Web Task Completion on MiniWoB++ Held-out Tasks (test)

70.4Success Rate

Claude-3.5-Sonnet

Updated 1mo ago

Evaluation Results

Method	Links
Claude-3.5-Sonnet 2025.07		70.4
GPT-4o-Mini 2025.07		66.1
o1-Mini 2025.07		66.1
Llama-3.1-70B-Instruct 2025.07		65.2
Llama-3.1-405B-Instruct 2025.07		65.2
GPT-4o 2025.07		64.3
Llama-3.1-8B SFT+RL (Ours) 2025.07		63.3
Llama-3.3-70B Instruct (Teacher) 2025.07		61.9
Qwen-2.5-7B SFT+RL (Ours) 2025.07		61.5
Qwen-2.5-72B Instruct (Teacher) 2025.07		59
Llama-3.1-8B SFT (Ours) 2025.07		56.7
Qwen-2.5-7B SFT (Ours) 2025.07		56.5
Qwen-2.5-7B RL (Ours) 2025.07		53
Llama-3.1-8B RL (Ours) 2025.07		43.5
Qwen-2.5-7B Instruct (Student) 2025.07		37
Llama-3.1-8B Instruct (Student) 2025.07		36.4