Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Ranking Free RAG: Replacing Re-ranking with Selection in RAG for Sensitive Domains

About

Retrieval-Augmented Generation (RAG) systems deployed in sensitive domains must provide interpretable evidence selection and robust safeguards against data poisoning, yet current approaches rely on opaque similarity-based retrieval with arbitrary top-k cutoffs that offer no explanation for their selections and remain vulnerable to adversarial manipulation. METEORA replaces re-ranking with rationale-driven selection via three components: a DPO-tuned LLM that generates explicit retrieval rationales, an Evidence Chunk Selection Engine (ECSE) that uses those rationales with statistical elbow detection for adaptive cutoff determination, and a Verifier LLM that filters poisoned evidence using the same rationales. Across six datasets, METEORA achieves 13.41% higher recall, 21.05% higher precision (without expansion), an 80% reduction in evidence volume, a 33.34% improvement in answer accuracy, and a 4.4x improvement in adversarial robustness. Human evaluation confirms genuine interpretability (3.64/5 confidence; 86% ground-truth agreement), demonstrating that interpretability, efficiency, and robustness are synergistic rather than competing objectives. The code is available in the GitHub repository https://github.com/YashSaxena21/METEORA

Yash Saxena, Ankur Padia, Mandar S Chaudhary, Kalpa Gunaratna, Srinivasan Parthasarathy, Manas Gaur• 2025

Related benchmarks

TaskDatasetResultRank
Context PrioritizationQasper
Recall@8100
12
Context PrioritizationContract-NLI
Recall@3100
12
Context PrioritizationPrivacyQA
Recall@6100
12
Context PrioritizationCUAD
R@1294
12
Context PrioritizationMAUD
R@3375
12
Context PrioritizationAverage QASPER, Contract-NLI, FinQA, PrivacyQA, CUAD, MAUD
Recall94
12
Context PruningFinQA
P@1312
12
Context PrioritizationFinQA
Recall@1097
12
Corpus poisoning detectionPrivacyQA
Precision60
6
Corpus poisoning detectionCUAD
Precision25
6
Showing 10 of 27 rows

Other info

Follow for update