MIRAGE: Defending Long-Form RAG Against Misinformation Pollution
About
Retrieval-Augmented Generation (RAG) improves factuality by grounding LLMs in external evidence, but real-world retrieval is often polluted: semantically relevant passages may contain subtle misinformation, misleading framings, or fabrications. We introduce MIRAGE, a training-free, model-agnostic defense for long-form RAG. MIRAGE builds an NLI-based cross-document claim graph and applies a Defended-Claims Gate to either condition generation on a consistent, multi-source supported subset or to block retrieval and answer parametrically. We also release a minimal-edit pollution protocol spanning four perturbation families (Unambiguous, Conflicting, Misleading, Fabricated) to construct matched clean, mixed, and fully polluted evaluation regimes. Across four long-form QA benchmarks and multiple commercial and open-weight LLMs, pollution severely degrades vanilla RAG, while MIRAGE consistently restores factuality under mixed and fully polluted evidence and outperforms prior robust-RAG methods. Our implementation and datasets are available at https://github.com/SaadElDine/MIRAGE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Long-form Question Answering | FAVA MixP (50% polluted) | VeriScore F1@k91.59 | 26 | |
| Long-form Question Answering | FAVA FullP (100% polluted) | VeriScore F1@k82.54 | 26 | |
| Long-form Question Answering | LongFact MixP (50% polluted) | VeriScore F1@k90.33 | 26 | |
| Long-form Question Answering | LongFact FullP (100% polluted) | VeriScore F1@k88.93 | 26 | |
| Long-form Question Answering | Biography MixP (50% polluted) | VeriScore F1@k70.11 | 26 | |
| Long-form Question Answering | Biography FullP (100% polluted) | VeriScore F1@k61.87 | 26 | |
| Long-form Question Answering | AlpacaFact MixP (50% polluted) | VeriScore F1@k81.7 | 26 | |
| Long-form Question Answering | AlpacaFact FullP (100% polluted) | VeriScore F1@k78.65 | 26 | |
| Long-form Question Answering | Long-form QA Datasets Average Clean RAG | VeriScore F1@k87.56 | 10 | |
| Long-form Question Answering | Long-form QA Datasets Average, Mixed Pollution | VeriScore F1@k83.43 | 10 |