Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ARNIQA: Learning Distortion Manifold for Image Quality Assessment

About

No-Reference Image Quality Assessment (NR-IQA) aims to develop methods to measure image quality in alignment with human perception without the need for a high-quality reference image. In this work, we propose a self-supervised approach named ARNIQA (leArning distoRtion maNifold for Image Quality Assessment) for modeling the image distortion manifold to obtain quality representations in an intrinsic manner. First, we introduce an image degradation model that randomly composes ordered sequences of consecutively applied distortions. In this way, we can synthetically degrade images with a large variety of degradation patterns. Second, we propose to train our model by maximizing the similarity between the representations of patches of different images distorted equally, despite varying content. Therefore, images degraded in the same manner correspond to neighboring positions within the distortion manifold. Finally, we map the image representations to the quality scores with a simple linear regressor, thus without fine-tuning the encoder weights. The experiments show that our approach achieves state-of-the-art performance on several datasets. In addition, ARNIQA demonstrates improved data efficiency, generalization capabilities, and robustness compared to competing methods. The code and the model are publicly available at https://github.com/miccunifi/ARNIQA.

Lorenzo Agnolucci, Leonardo Galteri, Marco Bertini, Alberto Del Bimbo• 2023

Related benchmarks

TaskDatasetResultRank
Image Quality AssessmentSPAQ
SRCC0.905
311
Image Quality AssessmentCSIQ
SRC0.962
192
No-Reference Image Quality AssessmentKADID-10K
SROCC0.908
189
Image Quality AssessmentAGIQA-3K
SRCC0.803
175
Image Quality AssessmentKADID
SRCC0.908
167
Image Quality AssessmentPIPAL
SRCC0.634
162
No-Reference Image Quality AssessmentCSIQ
SROCC0.962
144
Blind Image Quality AssessmentFLIVE
SRCC0.595
142
No-Reference Image Quality AssessmentTID 2013
SRCC0.88
136
No-Reference Image Quality AssessmentSPAQ
SROCC0.905
136
Showing 10 of 68 rows

Other info

Code

Follow for update