| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| ALFWorld | ReAct | Success Rate94 | 106 | 1mo ago | |
| EB-Habitat | Claude-4.6 | Avg Success Rate77 | 63 | 1mo ago | |
| ALFWorld | RLSD | Pick Success Rate100 | 54 | 29d ago | |
| ALFRED EB | Claude-4.6 | Avg Score92 | 36 | 1mo ago | |
| ALFRED unseen (test) | Prompter | Success Rate4,572 | 26 | 2mo ago | |
| ALFRED seen (test) | Prompter | Success Rate (SR)53.23 | 26 | 2mo ago | |
| ALFWorld ID | SKILL0 | Pick Success Rate94.3 | 18 | 1mo ago | |
| ALFWorld (test) | MASA | Pick Success Rate85.7 | 16 | 1mo ago | |
| ALFWorld (IOD) | SKILLGEN | Accuracy96.67 | 16 | 2mo ago | |
| ALFWorld (All tasks) | Evolving-RL | Overall Success Rate96 | 16 | 1mo ago | |
| ALFWorld v1.0 (test) | ReAct | Pick Success Rate100 | 15 | 2mo ago | |
| ALFWorld out-of-distribution (test) | 3SPO | Task Success Rate95.93 | 13 | 1mo ago | |
| AI2-THOR (test) | ReCAPA | SR75 | 11 | 3mo ago | |
| ALFWorld (Unseen tasks) | Evolving-RL | Look Success Rate100 | 10 | 2mo ago | |
| ALFWorld (Seen tasks) | Evolving-RL | Pick Success Rate97.5 | 10 | 2mo ago | |
| ALFWorld in-distribution held-out (test) | SkillFlow | Success Rate96.09 | 9 | 2mo ago | |
| ALFWorld (OOD) | SKILLGEN | Accuracy97.25 | 8 | 2mo ago | |
| ALFWorld-B | LWM-Planner | Cumulative Return22.89 | 7 | 1mo ago | |
| Crafter 5×5 Mini | Cumulative Return289 | 7 | 1mo ago | ||
| TextFrozenLake 4×4; h=0.9 | ReAct | Cumulative Return265.2 | 7 | 1mo ago | |
| ALFWorld (Mixed) | DPEPO | In-Domain Completion Rate98.6 | 7 | 2mo ago | |
| ALFWorld-C | LWM-Planner | Normalized Success Rate100 | 5 | 1mo ago | |
| ALFWorld-B | LWM-Planner | Normalized Success Rate100 | 5 | 1mo ago | |
| ALFWorld-A | LWM-Planner | Normalized Success Rate100 | 5 | 1mo ago | |
| ALFRED Unseen (val) | Seq2Seq + PM R2VLM | Task Success Rate (TSR)20 | 3 | 4mo ago |
