Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agents

About

Large Language Models (LLMs) are increasingly central to agentic systems due to their strong reasoning and planning capabilities. By interacting with external environments through predefined tools, these agents can carry out complex user tasks. Nonetheless, this interaction also introduces the risk of prompt injection attacks, where malicious inputs from external sources can mislead the agent's behavior, potentially resulting in economic loss, privacy leakage, or system compromise. System-level defenses have recently shown promise by enforcing static or predefined policies, but they still face two key challenges: the ability to dynamically update security rules and the need for memory stream isolation. To address these challenges, we propose DRIFT, a Dynamic Rule-based Isolation Framework for Trustworthy agentic systems, which enforces both control- and data-level constraints. A Secure Planner first constructs a minimal function trajectory and a JSON-schema-style parameter checklist for each function node based on the user query. A Dynamic Validator then monitors deviations from the original plan, assessing whether changes comply with privilege limitations and the user's intent. Finally, an Injection Isolator detects and masks any instructions that may conflict with the user query from the memory stream to mitigate long-term risks. We empirically validate the effectiveness of DRIFT on the AgentDojo and ASB benchmark, demonstrating its strong security performance while maintaining high utility across diverse models, showcasing both its robustness and adaptability. The code is released at https://github.com/SaFoLab-WISC/DRIFT.

Hao Li, Xiaogeng Liu, Hung-Chun Chiu, Dianqi Li, Ning Zhang, Chaowei Xiao• 2025

Related benchmarks

TaskDatasetResultRank
Prompt Injection DefenseAgentDojo No Attack
Benign Utility81.05
23
Prompt Injection DefenseAgentDojo Important Instructions
Utility under Attack0.7065
23
Prompt Injection DefenseAgentDojo New Attack 1
Utility under Attack71.45
23
Prompt Injection DefenseAgentDojo New Attack 2
Utility under Attack (UA)66.68
23
Tool-use agent security evaluationSIREN
Explicit Directive (UA)10.92
16
Indirect Prompt InjectionAgentDojo
Benign Utility58.48
12
Showing 6 of 6 rows

Other info

Follow for update