VirtualHome
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Human-robot teaming for household object rearrangement | VirtualHome 2.0 (test) | Success Rate80 | 19 | |
| Robotic Task Planning in Dynamic Environments | VirtualHome | Success Rate92 | 16 | |
| Interactive decision making | Virtualhome | Success Rate59.1 | 15 | |
| Instruction Execution | VirtualHome Unseen domains | Success Rate83.61 | 15 | |
| Continual Instruction Following | VirtualHome | SR61.12 | 15 | |
| Embodied Task Planning | VirtualHome (Seen) | Simple Success9,140 | 10 | |
| Multi-agent coordination | VirtualHome-Social Addition 4→5 | Average Steps48.213 | 6 | |
| Embodied Task Planning | VirtualHome (unseen domains) | Success Rate80.16 | 6 | |
| Few-shot task expansion | VirtualHome average performance (unseen domains) | SR82.59 | 5 | |
| Few-shot task expansion | VirtualHome unseen domains 5-shot | Success Rate83.61 | 5 | |
| Few-shot task expansion | VirtualHome unseen domains 1-shot | SR81.56 | 5 | |
| Embodied Task Planning | VirtualHome Novel Apartment (Unseen) | Simple Success Rate82.9 | 4 | |
| Setuptable | VirtualHome livingroom_and_bedroom | Task Success Rate (TSR)82.7 | 3 | |
| Setuptable | VirtualHome kitchen_and_bedroom | TSR81.9 | 3 | |
| Putfridge | VirtualHome kitchen and bathroom | TSR80.6 | 3 | |
| Putfridge | VirtualHome bathroom_and_livingroom | TSR81.9 | 3 | |
| Preparefood | VirtualHome bedroom_and_bathroom | TSR80.8 | 3 | |
| Preparefood | VirtualHome kitchen and livingroom | TSR80.8 | 3 | |
| Putdishwasher | VirtualHome livingroom_and_bedroom | TSR82.8 | 3 | |
| Readbook | VirtualHome bedroom_and_bathroom | TSR83.1 | 3 | |
| Readbook | VirtualHome bedroom_and_kitchen | TSR85.4 | 3 |
Showing 21 of 21 rows