Sentinel Challenge
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-agent Coordination | Sentinel Challenge 10 Patrolling Sentinels | Success Rate38.1 | 13 | |
| Multi-agent Coordination | Sentinel Challenge 10 Stationary Sentinels | Success Rate53.57 | 13 | |
| Multi-Agent Evasion and Navigation | Sentinel Challenge 20 Patrolling Sentinels | Success Rate32.14 | 11 | |
| Multi-Agent Evasion and Navigation | Sentinel Challenge 20 Stationary Sentinels | Success Rate35.71 | 11 | |
| Multi-agent navigation and evasion | Sentinel Challenge 10 Patrolling Sentinels (avg 14 scenes, 2 runs) | Success Rate64.29 | 11 | |
| Multi-agent navigation and evasion | Sentinel Challenge 10 Stationary Sentinels (avg 14 scenes, 2 runs) | Success Rate57.14 | 11 | |
| Embodied Cooperative Spatial Reasoning and Planning | Sentinel Challenge 5 Patrolling Sentinels | Success Rate35.71 | 6 | |
| Embodied Cooperative Spatial Reasoning and Planning | Sentinel Challenge 5 Stationary Sentinels | Success Rate39.29 | 6 | |
| Embodied Cooperative Spatial Reasoning and Planning | Sentinel Challenge Oracle Perception 5 Patrolling Sentinels (average over 14 scenes and 2 runs) | Success Rate57.14 | 5 | |
| Embodied Cooperative Spatial Reasoning and Planning | Sentinel Challenge Oracle Perception 5 Stationary Sentinels (average over 14 scenes and 2 runs) | Success Rate67.86 | 5 |
Showing 10 of 10 rows