Hanabi
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Zero-shot Coordination | Hanabi (test) | XP Score23.89 | 12 | |
| Ad-hoc Coordination | Hanabi w/ Clone Bot | Score16.59 | 5 | |
| Ad-hoc Coordination | Hanabi w/ Color Bot | Game Score21.78 | 5 | |
| Cooperative Play | Hanabi Cross-Play | Score23.76 | 5 | |
| Cooperative Play | Hanabi Self-play | Score24.14 | 5 | |
| Cooperative Multi-agent Game | Hanabi 2 Hints | Average Score23.76 | 5 | |
| Cooperative Multi-agent Game | Hanabi (Normal) | Average Score24.62 | 5 | |
| Hanabi | Hanabi 5-players Full-scale | Average Return23.04 | 4 | |
| Hanabi | Hanabi 4 players Full-scale | Average Return23.57 | 4 | |
| Hanabi | Hanabi 3-players Full-scale | Avg Return23.77 | 4 | |
| Hanabi | Hanabi Full-scale (2-players) | Average Return24 | 4 | |
| Ad-hoc Coordination | Hanabi w/ Rank Bot | Score17.01 | 4 | |
| Multi-agent coordination | Hanabi 3-player JaxMARL | SP24.66 | 3 | |
| Multi-agent coordination | Hanabi 2-player JaxMARL | SP24.49 | 3 | |
| Strategic game playing | Mini Hanabi (train) | Win Rate55.28 | 2 | |
| Multi-agent coordination | Hanabi 5-player JaxMARL | SP Score23.73 | 1 | |
| Multi-agent coordination | Hanabi 4-player JaxMARL | SP24.55 | 1 |
Showing 17 of 17 rows