Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

WaveMo: Learning Wavefront Modulations to See Through Scattering

About

Imaging through scattering media is a fundamental and pervasive challenge in fields ranging from medical diagnostics to astronomy. A promising strategy to overcome this challenge is wavefront modulation, which induces measurement diversity during image acquisition. Despite its importance, designing optimal wavefront modulations to image through scattering remains under-explored. This paper introduces a novel learning-based framework to address the gap. Our approach jointly optimizes wavefront modulations and a computationally lightweight feedforward "proxy" reconstruction network. This network is trained to recover scenes obscured by scattering, using measurements that are modified by these modulations. The learned modulations produced by our framework generalize effectively to unseen scattering scenarios and exhibit remarkable versatility. During deployment, the learned modulations can be decoupled from the proxy network to augment other more computationally expensive restoration algorithms. Through extensive experiments, we demonstrate our approach significantly advances the state of the art in imaging through scattering media. Our project webpage is at https://wavemo-2024.github.io/.

Mingyang Xie, Haiyun Guo, Brandon Y. Feng, Lingbo Jin, Ashok Veeraraghavan, Christopher A. Metzler• 2024

Related benchmarks

TaskDatasetResultRank
Image DeblurringSimulation
PSNR27.47
12
Image Reconstruction8 out-of-distribution static scenes (test)
PSNR14.61
5
Image ReconstructionStatic Scenes Out-of-distribution
SSIM32
5
Image Reconstruction40 static tissue samples (test)
PSNR19.06
3
Image ReconstructionTissue Samples
SSIM0.58
3
Image Reconstruction2 dynamic scenes 48 frames (test)
PSNR12.89
2
Image ReconstructionDynamic Scenes--
2
Showing 7 of 7 rows

Other info

Code

Follow for update