Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Equivariant Imaging: Learning Beyond the Range Space

About

In various imaging problems, we only have access to compressed measurements of the underlying signals, hindering most learning-based strategies which usually require pairs of signals and associated measurements for training. Learning only from compressed measurements is impossible in general, as the compressed observations do not contain information outside the range of the forward sensing operator. We propose a new end-to-end self-supervised framework that overcomes this limitation by exploiting the equivariances present in natural signals. Our proposed learning strategy performs as well as fully supervised methods. Experiments demonstrate the potential of this framework on inverse problems including sparse-view X-ray computed tomography on real clinical data and image inpainting on natural images. Code has been made available at: https://github.com/edongdongchen/EI.

Dongdong Chen, Juli\'an Tachella, Mike E. Davies• 2021

Related benchmarks

TaskDatasetResultRank
Image InpaintingUrban100 (test)
PSNR21.49
22
InpaintingDIV2K (test)
PSNR23.68
11
Sparse-View CT ReconstructionMayo sparse-view CT MPG noise, σ, γ = 5 × 10⁻³
PSNR31.3
8
Sparse-View CT ReconstructionMayo sparse-view CT MPG noise, σ, γ = 1 × 10⁻²
PSNR33.7
8
Sparse-View CT ReconstructionMayo sparse-view CT MPG noise, σ, γ = 5 × 10⁻³
PSNR34.71
8
Sparse-View CT ReconstructionSparse-view CT reconstruction (test)
PSNR35.03
7
Sparse-View CT ReconstructionAnatomy Shift Source: Body, Destination: Brain
PSNR35.98
6
Sparse-View CT ReconstructionDataset Shift Source: Mayo, Destination: SARS
PSNR32.84
6
Sparse-View CT ReconstructionRatio Shift Source: 50 views, Destination: 25 views
PSNR32.02
6
Image InpaintingDIV2K (test)
PSNR25.89
5
Showing 10 of 15 rows

Other info

Follow for update