Embodied Task Completion on ALFRED seen (test)
53.23Success Rate (SR)
Prompter
Updated 7d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2023.06 | 53.23 | 64.43 | 25.81 | 30.72 | |
2026.05 | 52.05 | 61.21 | 24.6 | 26.69 | |
2026.05 | 51.17 | 60.22 | 25.12 | 30.21 | |
2026.05 | 49.23 | 57.81 | 23.37 | 25.23 | |
2026.05 | 47.95 | 56.98 | 23.29 | 28.42 | |
2026.05 | 47.61 | 57.32 | 22.82 | 26.31 | |
2026.05 | 44.55 | 51.13 | 3.88 | 4.92 | |
2026.05 | 43.64 | 53.14 | 19.76 | 24.32 | |
2023.06 | 40.05 | 48.66 | 21.28 | 28.97 | |
2026.05 | 40.05 | 48.66 | 21.28 | 28.97 | |
2023.06 | 39.96 | 44.14 | 2.56 | 3.47 | |
2023.06 | 38.42 | 45.44 | 27.78 | 34.93 | |
2024.03 | 38.42 | 45.44 | - | - | |
2026.05 | 33.01 | 41.71 | 16.65 | 24.49 | |
2023.06 | 28.83 | 39.55 | 11.27 | 15.59 | |
2024.03 | 28.83 | 39.55 | - | - | |
2026.05 | 28.83 | 39.55 | 11.27 | 15.59 | |
2024.03 | 26.52 | 37.09 | - | - | |
2026.05 | 25.77 | 36.15 | 10.39 | 14.17 | |
2023.06 | 25.11 | 35.15 | 10.39 | 14.17 | |
2024.03 | 25.11 | 35.79 | - | - | |
2026.05 | 25.11 | 35.79 | 6.69 | 11.53 | |
2024.03 | 18.2 | 26.77 | - | - | |
2024.03 | 15.33 | 24.57 | - | - | |
2024.03 | 13.63 | 21.11 | - | - | |
2023.06 | 3.98 | 9.42 | 2.02 | 6.27 |