Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

QualiRAG: Retrieval-Augmented Generation for Visual Quality Understanding

About

Visual quality assessment (VQA) is increasingly shifting from scalar score prediction toward interpretable quality understanding -- a paradigm that demands \textit{fine-grained spatiotemporal perception} and \textit{auxiliary contextual information}. Current approaches rely on supervised fine-tuning or reinforcement learning on curated instruction datasets, which involve labor-intensive annotation and are prone to dataset-specific biases. To address these challenges, we propose \textbf{QualiRAG}, a \textit{training-free} \textbf{R}etrieval-\textbf{A}ugmented \textbf{G}eneration \textbf{(RAG)} framework that systematically leverages the latent perceptual knowledge of large multimodal models (LMMs) for visual quality perception. Unlike conventional RAG that retrieves from static corpora, QualiRAG dynamically generates auxiliary knowledge by decomposing questions into structured requests and constructing four complementary knowledge sources: \textit{visual metadata}, \textit{subject localization}, \textit{global quality summaries}, and \textit{local quality descriptions}, followed by relevance-aware retrieval for evidence-grounded reasoning. Extensive experiments show that QualiRAG achieves substantial improvements over open-source general-purpose LMMs and VQA-finetuned LMMs on visual quality understanding tasks, and delivers competitive performance on visual quality comparison tasks, demonstrating robust quality assessment capabilities without any task-specific training. The code will be publicly available at https://github.com/clh124/QualiRAG.

Linhan Cao, Wei Sun, Weixia Zhang, Xiangyang Zhu, Kaiwei Zhang, Jun Jia, Dandan Zhu, Guangtao Zhai, Xiongkuo Min• 2026

Related benchmarks

TaskDatasetResultRank
Image Quality ComparisonAGIQA
Accuracy79.28
16
Image Quality ComparisonPIPAL
Accuracy73.4
16
Image Quality ComparisonLIVE-C
Accuracy85.62
16
Video Quality ComparisonLIVE-HFR
Accuracy63.75
15
Video Quality ComparisonVDPVE
Accuracy74.46
15
Video Quality ComparisonKoNViD-1k
Accuracy80.33
15
Image Quality UnderstandingQ-Bench subset (dev)
Yes/No Accuracy85.82
14
Video Quality UnderstandingQ-Bench-Video (dev)
Yes-or-No Acc73.18
14
Showing 8 of 8 rows

Other info

Follow for update