Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

A Semi-supervised Nighttime Dehazing Baseline with Spatial-Frequency Aware and Realistic Brightness Constraint

About

Existing research based on deep learning has extensively explored the problem of daytime image dehazing. However, few studies have considered the characteristics of nighttime hazy scenes. There are two distinctions between nighttime and daytime haze. First, there may be multiple active colored light sources with lower illumination intensity in nighttime scenes, which may cause haze, glow and noise with localized, coupled and frequency inconsistent characteristics. Second, due to the domain discrepancy between simulated and real-world data, unrealistic brightness may occur when applying a dehazing model trained on simulated data to real-world data. To address the above two issues, we propose a semi-supervised model for real-world nighttime dehazing. First, the spatial attention and frequency spectrum filtering are implemented as a spatial-frequency domain information interaction module to handle the first issue. Second, a pseudo-label-based retraining strategy and a local window-based brightness loss for semi-supervised training process is designed to suppress haze and glow while achieving realistic brightness. Experiments on public benchmarks validate the effectiveness of the proposed method and its superiority over state-of-the-art methods. The source code and Supplementary Materials are placed in the https://github.com/Xiaofeng-life/SFSNiD.

Xiaofeng Cong, Jie Gui, Jing Zhang, Junming Hou, Hao Shen• 2024

Related benchmarks

TaskDatasetResultRank
Nighttime DehazingNHR (test)
PSNR24.157
38
Nighttime Image DehazingUNREAL-NH
SSIM0.862
32
Nighttime Image DehazingNHCL
SSIM97.9
32
Nighttime Image DehazingNHCM
SSIM96.8
32
Nighttime Image DehazingNHCD
SSIM0.951
32
Nighttime Image DehazingNHM
SSIM0.918
32
Surgical Smoke RemovalLSD3K (test)
PSNR25.666
20
Surgical Smoke RemovalDesmokeData (test)
PSNR28.6
20
Nighttime Haze RemovalNHRW 51
NIMA3.9077
16
Nighttime Image DehazingGTA5
SSIM0.935
12
Showing 10 of 14 rows

Other info

Code

Follow for update