ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images
About
Generative text-to-image models are advancing at an unprecedented pace, continuously shifting the perceptual quality ceiling and rendering previously collected labels unreliable for newer generations. To address this, we present ELIQ, a Label-free Framework for Quality Assessment of Evolving AI-generated Images. Specifically, ELIQ focuses on visual quality and prompt-image alignment, automatically constructs positive and aspect-specific negative pairs to cover both conventional distortions and AIGC-specific distortion modes, enabling transferable supervision without human annotations. Building on these pairs, ELIQ adapts a pre-trained multimodal model into a quality-aware critic via instruction tuning and predicts two-dimensional quality using lightweight gated fusion and a Quality Query Transformer. Experiments across multiple benchmarks demonstrate that ELIQ consistently outperforms existing label-free methods, generalizes from AI-generated content (AIGC) to user-generated content (UGC) scenarios without modification, and paves the way for scalable and label-free quality assessment under continuously evolving generative models. The code will be released upon publication.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Quality Assessment | SPAQ | SRCC0.915 | 191 | |
| Image Quality Assessment | AGIQA-3K | SRCC0.876 | 112 | |
| Image Quality Assessment | KonIQ-10k | SRCC0.912 | 96 | |
| Image Quality Assessment | AGIQA 3K (test) | SRCC0.789 | 84 | |
| Visual Quality Assessment | AIGCIQA 2023 | SRCC0.837 | 34 | |
| Alignment Quality Assessment | AIGCIQA2023 (test) | SRCC0.804 | 24 | |
| Visual Quality Assessment | AIGIQA-20K | SRCC0.856 | 22 |