Dual-Attention Heterogeneous GNN for Multi-robot Collaborative Area Search via Deep Reinforcement Learning
About
In multi-robot collaborative area search, a key challenge is to dynamically balance the two objectives of exploring unknown areas and covering specific targets to be rescued. Existing methods are often constrained by homogeneous graph representations, thus failing to model and balance these distinct tasks. To address this problem, we propose a Dual-Attention Heterogeneous Graph Neural Network (DA-HGNN) trained using deep reinforcement learning. Our method constructs a heterogeneous graph that incorporates three entity types: robot nodes, frontier nodes, and interesting nodes, as well as their historical states. The dual-attention mechanism comprises the relational-aware attention and type-aware attention operations. The relational-aware attention captures the complex spatio-temporal relationships among robots and candidate goals. Building on this relational-aware heterogeneous graph, the type-aware attention separately computes the relevance between robots and each goal type (frontiers vs. points of interest), thereby decoupling the exploration and coverage from the unified tasks. Extensive experiments conducted in interactive 3D scenarios within the iGibson simulator, leveraging the Gibson and MatterPort3D datasets, validate the superior scalability and generalization capability of the proposed approach.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-robot Exploration and Coverage | MatterPort3D Large Scene | Exploration Percentage98.95 | 12 | |
| Multi-robot Exploration and Coverage | MatterPort3D Medium Scene | Exploration (%)99.66 | 12 | |
| Multi-robot Exploration and Coverage | MatterPort3D Small Scene | Exploration Rate98.96 | 12 | |
| Multi-robot Coverage | Scenes Small (test) | Coverage74.72 | 6 | |
| Multi-robot Coverage | Scenes Medium (test) | Coverage (%)77.44 | 6 | |
| Multi-robot Coverage | Scenes Large (test) | Coverage74.17 | 6 | |
| Multi-robot Exploration | Scenes Small (test) | Exploration Coverage99.9 | 6 | |
| Multi-robot Exploration | Scenes Medium (test) | Exploration Coverage99.64 | 6 | |
| Multi-robot Exploration | Scenes Large (test) | Exploration Coverage (%)98.88 | 6 |