Instruction Following on ALFRED (test-unseen)
61.6GC
HELPER + ODIN
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2024.01 | 61.6 | - | - | 47.7 | |
2024.01 | 55 | - | - | 37.4 | |
2024.03 | 54.18 | 15.27 | 1,348 | 41.85 | |
2024.03 | 53.82 | 18.46 | 1,257 | 41.27 | |
2024.01 | 42.9 | - | - | 30.7 | |
2024.03 | 39.54 | 3.91 | 292 | 36.07 | |
2024.03 | 38.55 | 20.01 | 1,292 | 27.8 | |
2024.03 | 38.52 | - | - | 27.8 | |
2024.03 | 36.37 | 14.3 | 1,055 | 26.49 | |
2024.03 | 34.75 | 13.13 | 967 | 24.46 | |
2024.03 | 33.75 | - | - | 25.15 | |
2024.03 | 27.24 | 8.45 | 434 | 16.29 | |
2024.03 | 27.24 | - | - | 20.27 | |
2024.03 | 23.37 | - | - | 16.42 | |
2024.03 | 22.89 | - | - | 13.41 | |
2024.03 | 22.89 | - | - | 13.41 | |
2024.03 | 20.91 | 16.34 | 560 | 9.42 | |
2024.03 | 18.56 | 11.46 | 410 | 8.57 | |
2024.03 | 18.56 | - | - | 8.57 | |
2024.03 | 17.89 | - | - | 11.12 | |
2024.03 | 17.27 | 10.47 | 312 | 6.38 | |
2024.03 | 14.28 | 9.99 | 272 | 5.3 | |
2024.03 | 7.03 | 4.26 | 8 | 3.9 |