Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections

About

Web agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to prompt injection attacks embedded in HTML content or visual interfaces. Existing guard models still suffer from limited generalization to unseen domains and attack patterns, high false positive rates on benign content, reduced deployment efficiency due to added latency at each step, and vulnerability to adversarial attacks that evolve over time or directly target the guard itself. To address these limitations, we propose WARD (Web Agent Robust Defense against Prompt Injection), a practical guard model for secure and efficient web agents. WARD is built on WARD-Base, a large-scale dataset with around 177K samples collected from 719 high-traffic URLs and platforms, and WARD-PIG, a dedicated dataset designed for prompt injection attacks targeting the guard model. We further introduce A3T, an adaptive adversarial attack training framework that iteratively strengthens WARD through a memory-based attacker and guard co-evolution process. Extensive experiments show that WARD achieves nearly perfect recall on out-of-distribution benchmarks, maintains low false positive rates to preserve agent utility, remains robust against guard-targeted and adaptive attacks under substantial distribution shifts, and runs efficiently in parallel with the agent without introducing additional latency.

Tri Cao, Yulin Chen, Hieu Cao, Yibo Li, Khoi Le, Thong Nguyen, Yuexin Li, Yufei He, Yue Liu, Shuicheng Yan, Bryan Hooi• 2026

Related benchmarks

TaskDatasetResultRank
Prompt injection detectionPopUp attack (top visited websites)
Accuracy99.98
40
Prompt Injection and Jailbreak DetectionWARD (test)
Accuracy99.33
27
Prompt Injection and Jailbreak DetectionEIA
Recall100
25
Prompt Injection DefensePIArena
SQuAD v2 ASR1
5
Prompt Injection and Jailbreak DetectionVPI
Recall100
3
Prompt Injection and Jailbreak DetectionWASP
Recall100
2
Showing 6 of 6 rows

Other info

Follow for update