Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints
About
Communication enables coordination in multi-agent reinforcement learning (MARL), but many real-world applications, e.g., search-and-rescue with drone swarms, operate under severe bandwidth constraints. Many communication architectures still expose a coupled bottleneck in which a shared latent representation is used for both policy execution and inter-agent communication. Consequently, reducing message size directly limits the policy's latent space, often leading to significant performance degradation. We address this with two contributions. First, we introduce $\beta$, a normalised per-agent bandwidth budget that unifies sparsity, rounds, and message dimension into a single comparable constraint. Second, we provide SLIM, a minimal architecture that decouples the communication pathway from the policy's latent representation, allowing us to isolate the effect of bandwidth from the effect of policy capacity while benefiting from in-step communication. We evaluate our method on several partially-observable MARL benchmarks, where communication is essential. Our approach achieves state-of-the-art performance and exhibits scalability and robustness under limited communication, with only marginal degradation as bandwidth is reduced.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-agent Capture | Predator-Prey Easy (test) | Average Steps4.97 | 5 | |
| Multi-agent Capture | Predator-Prey Medium (test) | Average Steps12.57 | 5 | |
| Multi-agent coordination | Traffic Junction Easy (test) | Success Rate99.3 | 5 | |
| Multi-agent coordination | Traffic Junction Medium (test) | Success Rate97.2 | 5 | |
| Multi-agent Navigation | Navigation (test) | Reward81 | 4 |