Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Embodied Question Answering on MP3D-EQA v1 (test)
Loading...
47.78
Success Rate (SR)
NaviLLM
16.216
24.4105
32.605
40.7995
Dec 4, 2023
Success Rate (SR)
SPL
Accuracy (ACC)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Success Rate (SR)
SPL
Accuracy (ACC)
NaviLLM
GT Path=false, Evaluat...
2023.12
47.78
35.6
44.5
DUET (R2R)
GT Path=false, Evaluat...
2023.12
47
30.51
-
DUET (REVERIE)
GT Path=false, Evaluat...
2023.12
39.22
11.47
-
DUET (SOON)
GT Path=false, Evaluat...
2023.12
17.43
3.91
-
EQA (habitat-lab)
GT Path=true, Training...
2023.12
-
-
46
NaviLLM
GT Path=true, Evaluati...
2023.12
-
-
47.4
Feedback
Search any
task
Search any
task