Jericho
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text-based Task Completion | Jericho | Mean Normalised Score3.37 | 18 | |
| Text-based embodied task | Jericho | Success Rate15 | 13 | |
| Interactive Fiction | Jericho OOD (held-out games) | Average Score (Balances)11.2 | 9 | |
| Sequential Decision-Making | Jericho ID (meta-train) | Score (Detective)270.5 | 9 | |
| Text-based game playing | Jericho Zork3 (test) | Avg Score3.1 | 7 | |
| Text-based game playing | Jericho Zork1 (test) | Average Score53 | 7 | |
| Text-based game playing | Jericho Library (test) | Average Score25.9 | 7 | |
| Text-based Reinforcement Learning | Jericho benchmark (test) | DeepHome Score35.8 | 7 | |
| Text-based Game Playing | Jericho | Zork1 Score73 | 6 | |
| Text Adventure Game Playing | Jericho | Zork1 Score73 | 6 | |
| Interactive Fiction | Jericho (test) | Zork1 Completion Score40 | 4 | |
| Text-Based Adventure | Jericho | Omniquest Score10 | 3 |
Showing 12 of 12 rows