Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Embodied Instruction Following on LangR
Loading...
71
Average Success Rate
VEGAS
45
51.75
58.5
65.25
May 12, 2026
Average Success Rate
Rephrasing Success Rate
Contextual Understanding Success Rate
Irrelevant Text Handling Success Rate
Referring Expressions Success Rate
Multiple Rearrange Success Rate
Novel Objects Success Rate
Multiple Objects Success Rate
Conditional Success Rate
Updated 20d ago
Evaluation Results
Method
Method
Links
Average Success Rate
Rephrasing Success Rate
Contextual Understanding Success Rate
Irrelevant Text Handling Success Rate
Referring Expressions Success Rate
Multiple Rearrange Success Rate
Novel Objects Success Rate
Multiple Objects Success Rate
Conditional Success Rate
VEGAS
Backbone=Qwen-2.5-VL-3...
2026.05
71
99
52
92
62
82
97
34
48
w/ CoT
Backbone=Qwen-2.5-VL-3...
2026.05
65
98
50
85
59
64
97
25
42
w/ CoT + ZS Verifier
Backbone=Qwen-2.5-VL-3...
2026.05
64
98
50
85
48
65
97
30
40
SemLang
Backbone=LLaVA-1.5-7B
2026.05
58
92
46
66
31
80
97
2
46
No-CoT
Backbone=Qwen-2.5-VL-3...
2026.05
58
93
39
72
48
68
97
17
28
LLaRP
Backbone=LLaMa-7B
2026.05
46
92
34
32
26
47
95
0
39
Feedback
Search any
task
Search any
task
