Meta SecAlign: A Secure Foundation LLM Against Prompt Injection Attacks
About
Prompt injection attacks, where untrusted data contains an injected prompt to manipulate the system, have been listed as the top security threat to LLM-integrated applications. Model-level prompt injection defenses have shown strong effectiveness, but the strongest defenses are proprietary. Open-source secure models are needed by the AI security community so that co-development of attacks and defenses through open research can drive scientific progress in mitigating prompt injection attacks. To this end, we develop Meta SecAlign, the first fully open-source LLM with built-in model-level defense that achieves commercial-grade performance and is powerful enough for complex agentic tasks. We provide complete details of our training recipe. We perform the most comprehensive evaluation to date on 9 utility benchmarks (measuring general knowledge, instruction following, and agentic workflows) and 7 security benchmarks. Results show that Meta SecAlign, despite being trained only on generic instruction-tuning samples, surprisingly confers security in unseen downstream tasks, including tool-calling and web-navigation, in addition to general instruction-following. Our best model -- Meta-SecAlign-70B -- establishes a new frontier of utility-security trade-off for open-source LLMs, and is more secure than several flagship proprietary models with prompt injection defense. Below are links for the code (https://github.com/facebookresearch/Meta_SecAlign), Meta-SecAlign-70B (https://huggingface.co/facebook/Meta-SecAlign-70B), and Meta-SecAlign-8B (https://huggingface.co/facebook/Meta-SecAlign-8B) models.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| End-to-End Defense in RAG | SciFact | ASR21 | 69 | |
| End-to-End Defense in RAG | HotpotQA | Attack Success Rate (ASR)39 | 69 | |
| End-to-End Defense in RAG | ArguAna | Attack Success Rate (ASR)3 | 63 | |
| End-to-End Defense in RAG | FEVER | ASR16 | 63 | |
| RAG Attack Defense | Natural Questions | ASR39 | 63 | |
| End-to-End Defense in RAG | FiQA | ASR43 | 63 | |
| Question Answering | Dolly Closed QA | ASR30 | 36 | |
| Question Answering | SQuAD v2 | ASR Score0.09 | 36 | |
| Prompt Injection Defense | SEP | ASR1 | 24 | |
| Prompt Injection Defense | OPI (Open-Prompt-Injection) | ASR1 | 24 |