Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessment

About

No-reference (NR) image quality assessment (IQA) is an important tool in enhancing the user experience in diverse visual applications. A major drawback of state-of-the-art NR-IQA techniques is their reliance on a large number of human annotations to train models for a target IQA application. To mitigate this requirement, there is a need for unsupervised learning of generalizable quality representations that capture diverse distortions. We enable the learning of low-level quality features agnostic to distortion types by introducing a novel quality-aware contrastive loss. Further, we leverage the generalizability of vision-language models by fine-tuning one such model to extract high-level image quality information through relevant text prompts. The two sets of features are combined to effectively predict quality by training a simple regressor with very few samples on a target dataset. Additionally, we design zero-shot quality predictions from both pathways in a completely blind setting. Our experiments on diverse datasets encompassing various distortions show the generalizability of the features and their superior performance in the data-efficient and zero-shot settings. Code will be made available at https://github.com/suhas-srinath/GRepQ.

Suhas Srinath, Shankhanil Mitra, Shika Rao, Rajiv Soundararajan• 2023

Related benchmarks

TaskDatasetResultRank
Image Quality AssessmentSPAQ
SRCC0.903
275
Image Quality AssessmentCSIQ
SRC0.844
192
Image Quality AssessmentPIPAL
SRCC0.554
159
Image Quality AssessmentAGIQA-3K
SRCC0.807
137
Blind Image Quality AssessmentFLIVE
SRCC0.576
127
Image Quality AssessmentLIVE
SRC0.926
127
Image Quality AssessmentKonIQ-10k
SRCC0.882
126
Image Quality AssessmentAGIQA 3K (test)
SRCC0.807
84
Image Quality AssessmentTID 2013
SRC0.668
74
Image Quality AssessmentKADID-10K
SRCC0.808
62
Showing 10 of 32 rows

Other info

Follow for update