VirtualHome
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Human-robot teaming for household object rearrangement | VirtualHome 2.0 (test) | Success Rate80 | 19 | |
| Robotic Task Planning in Dynamic Environments | VirtualHome | Success Rate92 | 16 | |
| Instruction Execution | VirtualHome Unseen domains | Success Rate83.61 | 15 | |
| Continual Instruction Following | VirtualHome | SR61.12 | 15 | |
| Embodied Task Planning | VirtualHome (Seen) | Simple Success9,140 | 10 | |
| Embodied Task Planning | VirtualHome (unseen domains) | Success Rate80.16 | 6 | |
| Few-shot task expansion | VirtualHome average performance (unseen domains) | SR82.59 | 5 | |
| Few-shot task expansion | VirtualHome unseen domains 5-shot | Success Rate83.61 | 5 | |
| Few-shot task expansion | VirtualHome unseen domains 1-shot | SR81.56 | 5 | |
| Embodied Task Planning | VirtualHome Novel Apartment (Unseen) | Simple Success Rate82.9 | 4 |
Showing 10 of 10 rows