Fast Equivariant Imaging: Accelerating Unsupervised Learning and Model Adaptation via Inexact Splitting
About
In this work, we propose Fast Equivariant Imaging (FEI), a novel unsupervised learning framework to rapidly and efficiently train deep imaging networks without ground-truth data. FEI reformulates the EI objective through an inexact variable-splitting scheme, decoupling network training from an auxiliary restoration step implemented with a plug-and-play denoiser, this novel unsupervised scheme shows superior efficiency and performance compared to the standard Equivariant Imaging paradigm. In particular, our FEI schemes achieve an order-of-magnitude (10x) acceleration over standard EI on training U-Net for X-ray CT reconstruction and image inpainting, with improved generalization performance. Beyond offline training, the proposed scheme also enables efficient test-time adaptation of a pretrained model to individual samples, to secure further performance improvements. Extensive experiments show that the proposed approach provides a noticeable efficiency and performance gain over existing unsupervised methods and model adaptation techniques.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Inpainting | Urban100 (test) | PSNR23.56 | 22 | |
| Sparse-View CT Reconstruction | Mayo sparse-view CT MPG noise, σ, γ = 5 × 10⁻³ | PSNR36.04 | 8 | |
| Sparse-View CT Reconstruction | Mayo sparse-view CT MPG noise, σ, γ = 1 × 10⁻² | PSNR34.95 | 8 | |
| Sparse-View CT Reconstruction | Mayo sparse-view CT MPG noise, σ, γ = 5 × 10⁻³ | PSNR31.26 | 8 | |
| Sparse-View CT Reconstruction | Sparse-view CT reconstruction (test) | PSNR37.56 | 7 | |
| Sparse-View CT Reconstruction | Anatomy Shift Source: Body, Destination: Brain | PSNR37.82 | 6 | |
| Sparse-View CT Reconstruction | Dataset Shift Source: Mayo, Destination: SARS | PSNR33.42 | 6 | |
| Sparse-View CT Reconstruction | Ratio Shift Source: 50 views, Destination: 25 views | PSNR32.23 | 6 |