Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

OneRestore: A Universal Restoration Framework for Composite Degradation

About

In real-world scenarios, image impairments often manifest as composite degradations, presenting a complex interplay of elements such as low light, haze, rain, and snow. Despite this reality, existing restoration methods typically target isolated degradation types, thereby falling short in environments where multiple degrading factors coexist. To bridge this gap, our study proposes a versatile imaging model that consolidates four physical corruption paradigms to accurately represent complex, composite degradation scenarios. In this context, we propose OneRestore, a novel transformer-based framework designed for adaptive, controllable scene restoration. The proposed framework leverages a unique cross-attention mechanism, merging degraded scene descriptors with image features, allowing for nuanced restoration. Our model allows versatile input scene descriptors, ranging from manual text embeddings to automatic extractions based on visual attributes. Our methodology is further enhanced through a composite degradation restoration loss, using extra degraded images as negative samples to fortify model constraints. Comparative results on synthetic and real-world datasets demonstrate OneRestore as a superior solution, significantly advancing the state-of-the-art in addressing complex, composite degradations.

Yu Guo, Yuan Gao, Yuxu Lu, Huilin Zhu, Ryan Wen Liu, Shengfeng He• 2024

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementLOL
PSNR24.25
122
Image DehazingRESIDE SOTS
PSNR35.58
34
Image RestorationCDD-11 1.0 (test)
PSNR28.72
17
Image RestorationCDD 11 (test)
PSNR (Low)26.48
17
DesnowingSnow100k
PSNR30.24
12
Image RestorationCDD11-Double (H+R)
PSNR29.99
12
Image RestorationCDD11-Double (H+S)
PSNR30.21
12
Image RestorationCDD11-Double (L+H)
PSNR25.79
12
Image RestorationCDD11-Double (L+R)
PSNR25.58
12
Image RestorationCDD11-Double (L+S)
PSNR25.19
12
Showing 10 of 27 rows

Other info

Code

Follow for update