Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attacks

About

The security of LLM-based multi-agent systems (MAS) is critically threatened by propagation vulnerability, where malicious agents can distort collective decision-making through inter-agent message interactions. While existing supervised defense methods demonstrate promising performance, they may be impractical in real-world scenarios due to their heavy reliance on labeled malicious agents to train a supervised malicious detection model. To enable practical and generalizable MAS defenses, in this paper, we propose BlindGuard, an unsupervised defense method that learns without requiring any attack-specific labels or prior knowledge of malicious behaviors. To this end, we establish a hierarchical agent encoder to capture individual, neighborhood, and global interaction patterns of each agent, providing a comprehensive understanding for malicious agent detection. Meanwhile, we design a corruption-guided detector that consists of directional noise injection and contrastive learning, allowing effective detection model training solely on normal agent behaviors. Extensive experiments show that BlindGuard effectively detects diverse attack types (i.e., prompt injection, memory poisoning, and tool attack) across MAS with various communication patterns while maintaining superior generalizability compared to supervised baselines. The code is available at: https://github.com/MR9812/BlindGuard.

Rui Miao, Yixin Liu, Yili Wang, Xu Shen, Yue Tan, Yiwei Dai, Shirui Pan, Xin Wang• 2025

Related benchmarks

TaskDatasetResultRank
Prompt InjectionMMLU
ASR@318
31
Targeted AttackInjecAgent
ASR@317.42
31
Prompt InjectionCSQA
ASR@323.33
28
Malicious AgentPoisonRAG
ASR@314.67
28
Prompt InjectionGSM8K
ASR@310.33
28
Malicious AgentCSQA
ASR@30.2033
28
Showing 6 of 6 rows

Other info

Follow for update