GroupGuard: A Framework for Modeling and Defending Collusive Attacks in Multi-Agent Systems
About
While large language model-based agents demonstrate great potential in collaborative tasks, their interactivity also introduces security vulnerabilities. In this paper, we propose and model group collusive attacks, a highly destructive threat in which multiple agents coordinate via sociological strategies to mislead the system. To address this challenge, we introduce GroupGuard, a training-free defense framework that employs a multi-layered defense strategy, including continuous graph-based monitoring, active honeypot inducement, and structural pruning, to identify and isolate collusive agents. Experimental results across five datasets and four topologies demonstrate that group collusive attacks increase the attack success rate by up to 15\% compared to individual attacks. GroupGuard consistently achieves high detection accuracy (up to 88\%) and effectively restores collaborative performance, providing a robust solution for securing multi-agent systems.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Group Collusive Attack Detection | MMLU | Detection Accuracy92 | 27 | |
| Group Collusive Attack Detection | GSM8K | Detection Accuracy92 | 27 | |
| Group Collusive Attack Detection | MultiArith | Detection Accuracy92 | 27 | |
| Group Collusive Attack Detection | HumanEval | Detection Accuracy96 | 27 | |
| Group Collusive Attack Detection | SVAMP | Detection Accuracy92 | 27 | |
| Mathematical Reasoning | GSM8K | Accuracy under Attack (GSM8K)60 | 5 | |
| Multi-task Language Understanding | MMLU | Accuracy under Attack52 | 5 | |
| Code Generation | HumanEval | Accuracy (Attack)67 | 4 | |
| Mathematical Word Problems | SVAMP | Accuracy under Attack55 | 4 |