AccurateRAG: A Framework for Building Accurate Retrieval-Augmented Question-Answering Applications
About
We introduce AccurateRAG -- a novel framework for constructing high-performance question-answering applications based on retrieval-augmented generation (RAG). Our framework offers a pipeline for development efficiency with tools for raw dataset processing, fine-tuning data generation, text embedding & LLM fine-tuning, output evaluation, and building RAG systems locally. Experimental results show that our framework outperforms previous strong baselines and obtains new state-of-the-art question-answering performance on benchmark datasets.
Linh The Nguyen, Chi Tran, Dung Ngoc Nguyen, Van-Cuong Pham, Hoang Ngo, Dat Quoc Nguyen• 2025
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Question Answering | PubMedQA (test) | Accuracy82.4 | 128 | |
| Question Answering | HotpotQA (test) | Accuracy48.71 | 5 | |
| API Question Answering | APIBench Hugging Face (test) | Accuracy77.21 | 4 | |
| API Question Answering | APIBench Torch Hub (test) | Accuracy93.55 | 4 | |
| API Question Answering | APIBench TensorFlow Hub (test) | Accuracy88.91 | 4 |
Showing 5 of 5 rows