Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AccurateRAG: A Framework for Building Accurate Retrieval-Augmented Question-Answering Applications

About

We introduce AccurateRAG -- a novel framework for constructing high-performance question-answering applications based on retrieval-augmented generation (RAG). Our framework offers a pipeline for development efficiency with tools for raw dataset processing, fine-tuning data generation, text embedding & LLM fine-tuning, output evaluation, and building RAG systems locally. Experimental results show that our framework outperforms previous strong baselines and obtains new state-of-the-art question-answering performance on benchmark datasets.

Linh The Nguyen, Chi Tran, Dung Ngoc Nguyen, Van-Cuong Pham, Hoang Ngo, Dat Quoc Nguyen• 2025

Related benchmarks

TaskDatasetResultRank
Question AnsweringPubMedQA (test)
Accuracy82.4
128
Question AnsweringHotpotQA (test)
Accuracy48.71
5
API Question AnsweringAPIBench Hugging Face (test)
Accuracy77.21
4
API Question AnsweringAPIBench Torch Hub (test)
Accuracy93.55
4
API Question AnsweringAPIBench TensorFlow Hub (test)
Accuracy88.91
4
Showing 5 of 5 rows

Other info

Follow for update