Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions
About
Image restoration under multiple adverse weather conditions aims to develop a single model to recover the underlying scene with high visibility. Weather-related artifacts vary with the particle's distance to the camera according to the established scene visibility analysis, where close and faraway regions are more affected by falling drops and fog effects, respectively. Existing methods fail to consider this weather-specific physical visual process; thus, the restoration performance is limited. In this work, we analyze the common visual factors in adverse weather conditions and present a unified imaging model that considers the individually visible particles and fog-like aggregate scattering effects. Further, we design a novel weather-prior-based network, which leverages the weather-related prior information to help recover the scene by enhancing the features using the estimated occlusion and transmission. Experimental results in multiple adverse scenarios show the superiority of our method against state-of-the-art methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Dehazing | RESIDE | PSNR36.26 | 26 | |
| Image Deraining | Rain1400 | PSNR33.41 | 22 | |
| Desnowing | CSD | PSNR36.07 | 22 | |
| Object Detection | Snow | mAP44.2 | 14 | |
| Image Restoration | Rain-Haze Rain subset second experimental setting (test) | PSNR31.32 | 9 | |
| Image Restoration | RainDrop second experimental setting (test) | PSNR32.67 | 9 | |
| Image Restoration | Snow100K-L second experimental setting (test) | PSNR32.14 | 9 | |
| Image Dehazing | Weather30K Haze (test) | PSNR27.31 | 8 | |
| Image Deraining | Weather30K Rain (test) | PSNR28.84 | 8 | |
| Image Desnowing | Weather30K Snow (test) | PSNR26.34 | 8 |