Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GroupGuard: A Framework for Modeling and Defending Collusive Attacks in Multi-Agent Systems

About

While large language model-based agents demonstrate great potential in collaborative tasks, their interactivity also introduces security vulnerabilities. In this paper, we propose and model group collusive attacks, a highly destructive threat in which multiple agents coordinate via sociological strategies to mislead the system. To address this challenge, we introduce GroupGuard, a training-free defense framework that employs a multi-layered defense strategy, including continuous graph-based monitoring, active honeypot inducement, and structural pruning, to identify and isolate collusive agents. Experimental results across five datasets and four topologies demonstrate that group collusive attacks increase the attack success rate by up to 15\% compared to individual attacks. GroupGuard consistently achieves high detection accuracy (up to 88\%) and effectively restores collaborative performance, providing a robust solution for securing multi-agent systems.

Yiling Tao, Xinran Zheng, Shuo Yang, Meiling Tao, Xingjun Wang• 2026

Related benchmarks

TaskDatasetResultRank
Group Collusive Attack DetectionMMLU
Detection Accuracy92
27
Group Collusive Attack DetectionGSM8K
Detection Accuracy92
27
Group Collusive Attack DetectionMultiArith
Detection Accuracy92
27
Group Collusive Attack DetectionHumanEval
Detection Accuracy96
27
Group Collusive Attack DetectionSVAMP
Detection Accuracy92
27
Mathematical ReasoningGSM8K
Accuracy under Attack (GSM8K)60
5
Multi-task Language UnderstandingMMLU
Accuracy under Attack52
5
Code GenerationHumanEval
Accuracy (Attack)67
4
Mathematical Word ProblemsSVAMP
Accuracy under Attack55
4
Showing 9 of 9 rows

Other info

Follow for update