Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MemPot: Defending Against Memory Extraction Attack with Optimized Honeypots

About

Large Language Model (LLM)-based agents employ external and internal memory systems to handle complex, goal-oriented tasks, yet this exposes them to severe extraction attacks, and effective defenses remain lacking. In this paper, we propose MemPot, the first theoretically verified defense framework against memory extraction attacks by injecting optimized honeypots into the memory. Through a two-stage optimization process, MemPot generates trap documents that maximize the retrieval probability for attackers while remaining inconspicuous to benign users. We model the detection process as Wald's Sequential Probability Ratio Test (SPRT) and theoretically prove that MemPot achieves a lower average number of sampling rounds compared to optimal static detectors. Empirically, MemPot significantly outperforms state-of-the-art baselines, achieving a 50% improvement in detection AUROC and an 80% increase in True Positive Rate under low False Positive Rate constraints. Furthermore, our experiments confirm that MemPot incurs zero additional online inference latency and preserves the agent's utility on standard tasks, verifying its superiority in safety, harmlessness, and efficiency.

Yuhao Wang, Shengfang Zhai, Guanghao Jin, Yinpeng Dong, Linyi Yang, Jiaheng Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Internal memory extraction attack detectionEHRAgent
AUROC1
12
Internal memory extraction attack detectionRAP WebShop
AUROC1
12
External memory extraction attack detectionPokemon
AUROC1
9
External memory extraction attack detectionHealthMagicCare
AUROC100
9
Showing 4 of 4 rows

Other info

Follow for update