Share your thoughts, 1 month free Claude Pro on usSee more

Web-based Agent Interaction on WebShop (test)

73Success Rate

Fed-SE

Updated 4d ago

Evaluation Results

Method	Links
Fed-SE 2025.12		73
Centralized 2025.12		71
Fed-SE 2025.12		68
FedIT 2025.12		67.5
Fed-SE 2025.12		66
Local 2025.12		65
Fed-SE 2025.12		65
Local 2025.12		64.5
FedIT 2025.12		64.5
FedIT 2025.12		63.5
Centralized 2025.12		61.5
FedIT 2025.12		61
Local 2025.12		60
Centralized 2025.12		59
Fed-SE 2025.12		57.5
Local 2025.12		54
Local 2025.12		52
FedIT 2025.12		50.5
Centralized 2025.12		44.5
Centralized 2025.12		33.5
GPT-4o 2026.04		31.39
GPT-4o-mini 2026.04		25.3
Qwen2-7B + MISE 2026.04		25.15
LLaMA3-8B + MISE 2026.04		24.34
Qwen2-7B + PRM 2026.04		23.81
Qwen2-7B + PPO 2026.04		23.75
Qwen2-7B 2026.04		23.38
LLaMA3-8B + PRM 2026.04		22.81
LLaMA3-8B + PPO 2026.04		22.47
LLaMA3-8B + RFT 2026.04		21.97
LLaMA3-8B + online DPO 2026.04		20.96
LLaMA3-8B 2026.04		20.14
LLaMA3-8B + ReAct 2026.04		19.98
Pre-Trained 2025.12		7
Pre-Trained 2025.12		3
Pre-Trained 2025.12		2
Pre-Trained 2025.12		1.5
Pre-Trained 2025.12		0
Gemma2-9B 2026.04		0
Gemma2-9B + PPO 2026.04		0
Gemma2-9B + PRM 2026.04		0
Gemma2-9B + MISE 2026.04		0