Noise2Ghost: Self-supervised deep convolutional reconstruction for ghost imaging
About
We present a new self-supervised deep-learning-based Ghost Imaging (GI) reconstruction method, which provides unparalleled reconstruction quality for noisy acquisitions among unsupervised methods. We present the supporting mathematical framework and results from theoretical and real data use cases. Self-supervision removes the need for clean reference data while offering strong noise reduction. This provides the necessary tools for addressing signal-to-noise ratio concerns for GI acquisitions in emerging and cutting-edge low-light GI scenarios. Notable examples include micro- and nano-scale x-ray emission imaging, e.g., x-ray fluorescence imaging of dose-sensitive samples. Their applications include in-vivo and in-operando case studies for biological samples and batteries.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Ghost Imaging Reconstruction | Chromosomes phantom synthetic (test) | MSE0.001 | 7 | |
| Ghost Imaging Reconstruction | Chromosomes phantom 3x compression, high Poisson noise | MSE0.006 | 7 | |
| XRF-GI Reconstruction | Real XRF-GI Cu wires 100% photon count | PSNR35.33 | 4 | |
| XRF-GI Reconstruction | Real XRF-GI (Cu wires) 12.9% photon count | PSNR27.75 | 4 | |
| XRF-GI Reconstruction | Real XRF-GI Cu wires 2.6% photon count | PSNR23.76 | 4 |