Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Embodied Question Answering on MP3D-EQA v1 (test)
Loading...
47.78
Success Rate (SR)
NaviLLM
16.216
24.4105
32.605
40.7995
Dec 4, 2023
Success Rate (SR)
SPL
Accuracy (ACC)
Updated 4d ago
Evaluation Results
Method
Method
Links
Success Rate (SR)
SPL
Accuracy (ACC)
NaviLLM
GT Path=false, Evaluat...
2023.12
47.78
35.6
44.5
DUET (R2R)
GT Path=false, Evaluat...
2023.12
47
30.51
-
DUET (REVERIE)
GT Path=false, Evaluat...
2023.12
39.22
11.47
-
DUET (SOON)
GT Path=false, Evaluat...
2023.12
17.43
3.91
-
EQA (habitat-lab)
GT Path=true, Training...
2023.12
-
-
46
NaviLLM
GT Path=true, Evaluati...
2023.12
-
-
47.4
Feedback
Search any
task
Search any
task