Multivariate Fields of Experts for Convergent Image Reconstruction
About
We introduce the multivariate fields of experts, a new framework for the learning of image priors. Our model generalizes existing fields of experts methods by incorporating multivariate potential functions constructed via Moreau envelopes of the $\ell_\infty$-norm. We demonstrate the effectiveness of our proposal across a range of inverse problems that include image denoising, deblurring, compressed-sensing magnetic-resonance imaging, and computed tomography. The proposed approach outperforms comparable univariate models and achieves performance close to that of deep-learning-based regularizers while being significantly faster, requiring fewer parameters, and being trained on substantially fewer data. In addition, our model retains a high level of interpretability due to its structured design. It is supported by theoretical convergence guarantees which ensure reliability in sensitive reconstruction tasks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Denoising | BSD68 | PSNR31.32 | 404 | |
| Image Denoising | Set14 | PSNR31.96 | 67 | |
| Deblurring | BSD68 | PSNR30.65 | 24 | |
| Image Denoising | McMaster | PSNR33.53 | 18 | |
| CT Reconstruction | LoDoPaB (test) | PSNR35.4 | 15 | |
| MRI Reconstruction | fastMRI PD | PSNR35.4 | 10 | |
| MRI Reconstruction | fastMRI PDFS | PSNR34.21 | 10 | |
| CT Reconstruction | CT (test) | Average Duration (s)10.26 | 4 | |
| Image Deblurring | Deblurring (test) | Average Duration (s)5.9 | 4 | |
| CS-MRI Reconstruction | CS-MRI (test) | Average Latency (s)10.94 | 4 |