PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agents
About
Large Language Models (LLMs) struggle with generating reliable outputs due to outdated knowledge and hallucinations. Retrieval-Augmented Generation (RAG) models address this by enhancing LLMs with external knowledge, but often fail to personalize the retrieval process. This paper introduces PersonaRAG, a novel framework incorporating user-centric agents to adapt retrieval and generation based on real-time user data and interactions. Evaluated across various question answering datasets, PersonaRAG demonstrates superiority over baseline models, providing tailored answers to user needs. The results suggest promising directions for user-adapted information retrieval systems.
Saber Zerhoudi, Michael Granitzer• 2024
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Classification | AI Persona | Power-Seeking45.5 | 14 | |
| Role-playing Multiple-choice Evaluation | RoleAgentBench | Friends Accuracy30.61 | 8 | |
| Personalization | Qwen2.5-14B Power-Seeking | Power-Seeking0.47 | 6 | |
| Personalization | Qwen2.5-14B Wealth-Seeking | Wealth-Seeking Score56.5 | 6 |
Showing 4 of 4 rows