Wolfpack Adversarial Attack for Robust Multi-Agent Reinforcement Learning
About
Traditional robust methods in multi-agent reinforcement learning (MARL) often struggle against coordinated adversarial attacks in cooperative scenarios. To address this limitation, we propose the Wolfpack Adversarial Attack framework, inspired by wolf hunting strategies, which targets an initial agent and its assisting agents to disrupt cooperation. Additionally, we introduce the Wolfpack-Adversarial Learning for MARL (WALL) framework, which trains robust MARL policies to defend against the proposed Wolfpack attack by fostering systemwide collaboration. Experimental results underscore the devastating impact of the Wolfpack attack and the significant robustness improvements achieved by WALL. Our code is available at https://github.com/sunwoolee0504/WALL.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-Agent Reinforcement Learning | SMAC (test) | Win Rate (2s3z)99.8 | 56 | |
| Multi-Agent Reinforcement Learning | SMAC | Win Rate (3m)99.7 | 34 | |
| Multi-Agent Reinforcement Learning (Predator-Prey) | MPE PP_3/1 | Average Cumulative Reward202.9 | 16 | |
| Multi-Agent Reinforcement Learning (Predator-Prey) | MPE PP_6/2 | Average Cumulative Reward685.5 | 16 | |
| Multi-Agent Reinforcement Learning (Predator-Prey) | MPE PP_9/3 | Average Cumulative Reward802.5 | 16 | |
| Multi-Agent Reinforcement Learning | SMAC 3m | Win Rate35.4 | 13 | |
| Multi-Agent Reinforcement Learning | SMAC 2s3z StarCraft II (test) | Natural Acc98.9 | 9 | |
| Multi-Agent Reinforcement Learning | SMAC 8m | Disparity (Dis-1)25.4 | 9 | |
| Multi-Agent Reinforcement Learning | SMAC MMM | Win Rate (Dis-1)77.1 | 9 | |
| Multi-Agent Reinforcement Learning | SMAC 1c3s5z v1 | Natural Performance98.9 | 9 |