Fast Equivariant Imaging: Acceleration for Unsupervised Learning via Augmented Lagrangian and Auxiliary PnP Denoisers
About
In this work, we propose Fast Equivariant Imaging (FEI), a novel unsupervised learning framework to rapidly and efficiently train deep imaging networks without ground-truth data. From the perspective of reformulating the Equivariant Imaging based optimization problem via the method of Lagrange multipliers and utilizing plug-and-play denoisers, this novel unsupervised scheme shows superior efficiency and performance compared to the vanilla Equivariant Imaging paradigm. In particular, our FEI schemes achieve an order-of-magnitude (10x) acceleration over standard EI on training U-Net for X-ray CT reconstruction and image inpainting, with improved generalization performance. In addition, the proposed scheme enables efficient test-time adaptation of a pretrained model to individual samples to secure further performance improvements. Extensive experiments show that the proposed approach provides a noticeable efficiency and performance gain over existing unsupervised methods and model adaptation techniques.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Inpainting | Urban100 (test) | PSNR23.56 | 22 | |
| Sparse-View CT Reconstruction | Mayo sparse-view CT MPG noise, σ, γ = 5 × 10⁻³ | PSNR36.04 | 8 | |
| Sparse-View CT Reconstruction | Mayo sparse-view CT MPG noise, σ, γ = 1 × 10⁻² | PSNR34.95 | 8 | |
| Sparse-View CT Reconstruction | Mayo sparse-view CT MPG noise, σ, γ = 5 × 10⁻³ | PSNR31.26 | 8 | |
| Sparse-View CT Reconstruction | Sparse-view CT reconstruction (test) | PSNR37.56 | 7 | |
| Sparse-View CT Reconstruction | Anatomy Shift Source: Body, Destination: Brain | PSNR37.82 | 6 | |
| Sparse-View CT Reconstruction | Dataset Shift Source: Mayo, Destination: SARS | PSNR33.42 | 6 | |
| Sparse-View CT Reconstruction | Ratio Shift Source: 50 views, Destination: 25 views | PSNR32.23 | 6 |