Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Defense Against Adversarial Attacks on No-Reference Image Quality Models with Gradient Norm Regularization

About

The task of No-Reference Image Quality Assessment (NR-IQA) is to estimate the quality score of an input image without additional information. NR-IQA models play a crucial role in the media industry, aiding in performance evaluation and optimization guidance. However, these models are found to be vulnerable to adversarial attacks, which introduce imperceptible perturbations to input images, resulting in significant changes in predicted scores. In this paper, we propose a defense method to improve the stability in predicted scores when attacked by small perturbations, thus enhancing the adversarial robustness of NR-IQA models. To be specific, we present theoretical evidence showing that the magnitude of score changes is related to the $\ell_1$ norm of the model's gradient with respect to the input image. Building upon this theoretical foundation, we propose a norm regularization training strategy aimed at reducing the $\ell_1$ norm of the gradient, thereby boosting the robustness of NR-IQA models. Experiments conducted on four NR-IQA baseline models demonstrate the effectiveness of our strategy in reducing score changes in the presence of adversarial attacks. To the best of our knowledge, this work marks the first attempt to defend against adversarial attacks on NR-IQA models. Our study offers valuable insights into the adversarial robustness of NR-IQA models and provides a foundation for future research in this area.

Yujia Liu, Chenxi Yang, Dingquan Li, Jianhao Ding, Tingting Jiang• 2024

Related benchmarks

TaskDatasetResultRank
No-Reference Image Quality AssessmentLIVEC
SROCC1
64
No-Reference Image Quality AssessmentLIVEC (test)
PLCC (MOS vs Predicted After Attack)0.875
32
Non-Reference Image Quality AssessmentLIVEC (test)
RMSE12.593
32
No-Reference Image Quality AssessmentNR-IQA (test)
Avg ΔRMSE-31.59
12
No-Reference Image Quality AssessmentLIVEC FGSM attack (test)
Quality Score R3.864
8
No-Reference Image Quality AssessmentLIVEC Perceptual attack (test)
R Score5.492
8
No-Reference Image Quality AssessmentLIVEC UAP* attack (test)
R Score3.464
8
No-Reference Image Quality AssessmentLIVEC Kor.* attack (test)
Correlation (R)3.319
8
Showing 8 of 8 rows

Other info

Code

Follow for update