Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Interactive Planning on ALFRED unseen (val)
Loading...
67.8
Success Rate (SR)
Qwen2-VL-72B
4.9008
21.2304
37.56
53.8896
Mar 18, 2024
Apr 17, 2024
May 18, 2024
Jun 18, 2024
Jul 18, 2024
Aug 18, 2024
Sep 18, 2024
Success Rate (SR)
Goal Completion (GC)
HLP
Updated 4d ago
Evaluation Results
Method
Method
Links
Success Rate (SR)
Goal Completion (GC)
HLP
Qwen2-VL-72B
Model Parameters=72B
2024.09
67.8
75.8
-
Previous SOTA
2024.09
67.7
75.3
-
Scene-LLM
Step-by-step instructi...
2024.03
22.35
38.86
79.63
HLSM
Step-by-step instructi...
2024.03
18.28
31.24
70.17
LLM-Planner
Step-by-step instructi...
2024.03
15.36
29.88
68.31
LLM-Planner
Step-by-step instructi...
2024.03
12.92
25.35
55.85
HITUT
Step-by-step instructi...
2024.03
10.23
20.71
-
E.T.
Step-by-step instructi...
2024.03
7.32
20.87
-
FILM
Step-by-step instructi...
2024.03
-
-
54.93
Feedback
Search any
task
Search any
task