Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution

About

Despite the growing popularity of video super-resolution (VSR), there is still no good way to assess the quality of the restored details in upscaled frames. Some SR methods may produce the wrong digit or an entirely different face. Whether a method's results are trustworthy depends on how well it restores truthful details. Image super-resolution can use natural distributions to produce a high-resolution image that is only somewhat similar to the real one. VSR enables exploration of additional information in neighboring frames to restore details from the original scene. The ERQA metric, which we propose in this paper, aims to estimate a model's ability to restore real details using VSR. On the assumption that edges are significant for detail and character recognition, we chose edge fidelity as the foundation for this metric. Experimental validation of our work is based on the MSU Video Super-Resolution Benchmark, which includes the most difficult patterns for detail restoration and verifies the fidelity of details from the original frame. Code for the proposed metric is publicly available at https://github.com/msu-video-group/ERQA.

Anastasia Kirillova, Eugene Lyapustin, Anastasia Antsiferova, Dmitry Vatolin• 2021

Related benchmarks

TaskDatasetResultRank
Artifact DetectionProposed Dataset SPAN
F1 Score0.0474
28
Artifact DetectionProposed Dataset RLFN
F1 Score3.99
28
Artifact DetectionProposed Dataset prominent subset
IoU24.95
28
Image Quality AssessmentIQA Lego, Toy, Faces, Yarn, QRs, Text, Car, Mira (test)
Lego Score87
15
Artifact DetectionDeSRA MSE-SR
F1-score0.0396
14
Artifact DetectionProposed Dataset Original HR
F1 Score0.28
14
Artifact DetectionProposed & DeSRA Combined
Rank9.8
12
Artifact RemovalDeSRA Target SR: LDL 1.0 (test)
ΔIoU0.67
6
Artifact RemovalDeSRA Target SR: RealESRGAN 1.0 (test)
∆IoU1.22
6
Artifact RemovalDeSRA Target SR: SwinIR 1.0 (test)
∆IoU0.0019
6
Showing 10 of 10 rows

Other info

Code

Follow for update