ALFRED
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Instruction Following | ALFRED | Accuracy19.84 | 36 | |
| Continual Instruction Following | ALFRED | Success Rate (SR)69.9 | 28 | |
| Instruction following | ALFRED (test-unseen) | GC61.6 | 23 | |
| Embodied Instruction Following | ALFRED seen 1.0 (test) | GC54.81 | 20 | |
| Embodied Task Completion | ALFRED unseen (test) | Success Rate4,572 | 14 | |
| Embodied Task Completion | ALFRED seen (test) | Success Rate (SR)53.23 | 14 | |
| Embodied Task Completion | ALFRED EB | Avg Score32.2 | 8 | |
| 3D Instruction Following | ALFRED | Accuracy62 | 8 | |
| Interactive Planning | ALFRED unseen (val) | Success Rate (SR)67.8 | 8 | |
| Interactive Planning | ALFRED (val seen) | SR46.59 | 6 | |
| Action Sequence Generation | ALFRED (val unseen) | Exact Match91 | 4 | |
| High-level Planning | ALFRED (val unseen) | EM64 | 4 | |
| Subtask Completion | ALFRED | Avg Completion Rate0.53 | 4 | |
| Embodied Instruction Following | ALFRED (Seen) | Success Rate (SR)33.5 | 3 |
Showing 14 of 14 rows