Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Plug In, Grade Right: Psychology-Inspired AGIQA

About

Existing AGIQA models typically estimate image quality by measuring and aggregating the similarities between image embeddings and text embeddings derived from multi-grade quality descriptions. Although effective, we observe that such similarity distributions across grades usually exhibit multimodal patterns. For instance, an image embedding may show high similarity to both "excellent" and "poor" grade descriptions while deviating from the "good" one. We refer to this phenomenon as "semantic drift", where semantic inconsistencies between text embeddings and their intended descriptions undermine the reliability of text-image shared-space learning. To mitigate this issue, we draw inspiration from psychometrics and propose an improved Graded Response Model (GRM) for AGIQA. The GRM is a classical assessment model that categorizes a subject's ability across grades using test items with various difficulty levels. This paradigm aligns remarkably well with human quality rating, where image quality can be interpreted as an image's ability to meet various quality grades. Building on this philosophy, we design a two-branch quality grading module: one branch estimates image ability while the other constructs multiple difficulty levels. To ensure monotonicity in difficulty levels, we further model difficulty generation in an arithmetic manner, which inherently enforces a unimodal and interpretable quality distribution. Our Arithmetic GRM based Quality Grading (AGQG) module enjoys a plug-and-play advantage, consistently improving performance when integrated into various state-of-the-art AGIQA frameworks. Moreover, it also generalizes effectively to both natural and screen content image quality assessment, revealing its potential as a key component in future IQA models.

Zhicheng Liao, Baoliang Chen, Hanwei Zhu, Lingyu Zhu, Shiqi Wang, Weisi Lin• 2025

Related benchmarks

TaskDatasetResultRank
Image Quality AssessmentAGIQA-3K
SRCC0.8911
112
Image Quality AssessmentAGIQA 3K (test)
SRCC0.767
84
Image Quality AssessmentAGIQA-1K
SRCC0.8606
51
Quality AssessmentAIGCIQA 2023
SRCC0.8671
36
Consistency AssessmentAIGCIQA 2023
SRCC0.8052
16
Quality AssessmentAIGCIQA 2023 (test)
SRCC0.778
16
Consistency AssessmentAGIQA-3K
SRCC0.7717
15
Consistency AssessmentAGIQA 3K (test)
SRCC0.663
14
Consistency AssessmentAIGCIQA2023 (test)
SRCC0.626
14
Showing 9 of 9 rows

Other info

Follow for update