Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Semantic Area Graph Reasoning for Multi-Robot Language-Guided Search

About

Coordinating multi-robot systems (MRS) to search in unknown environments is particularly challenging for tasks that require semantic reasoning beyond geometric exploration. Classical coordination strategies rely on frontier coverage or information gain and cannot incorporate high-level task intent, such as searching for objects associated with specific room types. We propose \textit{Semantic Area Graph Reasoning} (SAGR), a hierarchical framework that enables Large Language Models (LLMs) to coordinate multi-robot exploration and semantic search through a structured semantic-topological abstraction of the environment. SAGR incrementally constructs a semantic area graph from a semantic occupancy map, encoding room instances, connectivity, frontier availability, and robot states into a compact task-relevant representation for LLM reasoning. The LLM performs high-level semantic room assignment based on spatial structure and task context, while deterministic frontier planning and local navigation handle geometric execution within assigned rooms. Experiments on the Habitat-Matterport3D dataset across 100 scenarios show that SAGR remains competitive with state-of-the-art exploration methods while consistently improving semantic target search efficiency, with up to 18.8\% in large environments. These results highlight the value of structured semantic abstractions as an effective interface between LLM-based reasoning and multi-robot coordination in complex indoor environments.

Ruiyang Wang, Hao-Lun Hsu, Jiwoo Kim, Miroslav Pajic• 2026

Related benchmarks

TaskDatasetResultRank
Semantic SearchHM3D Small
Average Completion Time (steps)178.8
4
Semantic SearchHM3D Medium
Average Completion Time (steps)190.4
4
Semantic SearchHM3D Large
Average Completion Time (steps)228
4
Semantic SearchMedium-scale environment
Average Completion Time (steps)207.1
4
ExplorationHM3D Small
Average Completion Time (steps)500.5
4
ExplorationHM3D Medium
Average Completion Time (steps)559.9
4
ExplorationHM3D Large
Average Completion Time (steps)825.6
4
Explorationenvironment Medium-scale
Average Completion Time (steps)537.8
4
Showing 8 of 8 rows

Other info

Follow for update