Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessment

About

No-Reference Image Quality Assessment (NR-IQA) focuses on designing methods to measure image quality in alignment with human perception when a high-quality reference image is unavailable. Most state-of-the-art NR-IQA approaches are opinion-aware, i.e. they require human annotations for training. This dependency limits their scalability and broad applicability. To overcome this limitation, we propose QualiCLIP (Quality-aware CLIP), a CLIP-based self-supervised opinion-unaware approach that does not require human opinions. In particular, we introduce a quality-aware image-text alignment strategy to make CLIP generate quality-aware image representations. Starting from pristine images, we synthetically degrade them with increasing levels of intensity. Then, we train CLIP to rank these degraded images based on their similarity to quality-related antonym text prompts. At the same time, we force CLIP to generate consistent representations for images with similar content and the same level of degradation. Our experiments show that the proposed method improves over existing opinion-unaware approaches across multiple datasets with diverse distortion types. Moreover, despite not requiring human annotations, QualiCLIP achieves excellent performance against supervised opinion-aware methods in cross-dataset experiments, thus demonstrating remarkable generalization capabilities. The code and the model are publicly available at https://github.com/miccunifi/QualiCLIP.

Lorenzo Agnolucci, Leonardo Galteri, Marco Bertini• 2024

Related benchmarks

TaskDatasetResultRank
Image Quality AssessmentSPAQ
SRCC0.911
191
Image Quality AssessmentCSIQ
SRC0.804
138
Image Quality AssessmentAGIQA-3K
SRCC0.86
112
Image Quality AssessmentKonIQ-10k
SRCC0.889
96
Image Quality AssessmentLIVE
SRC0.898
96
Image Quality AssessmentPIPAL
SRCC0.586
95
Blind Image Quality AssessmentFLIVE
SRCC0.618
86
Image Quality AssessmentAGIQA 3K (test)
SRCC0.667
84
Image Quality AssessmentTID 2013
SRC0.651
74
Image Quality AssessmentAGIQA-1K
SRCC0.826
51
Showing 10 of 28 rows

Other info

Code

Follow for update