StructureFlow: Image Inpainting via Structure-aware Appearance Flow
About
Image inpainting techniques have shown significant improvements by using deep neural networks recently. However, most of them may either fail to reconstruct reasonable structures or restore fine-grained textures. In order to solve this problem, in this paper, we propose a two-stage model which splits the inpainting task into two parts: structure reconstruction and texture generation. In the first stage, edge-preserved smooth images are employed to train a structure reconstructor which completes the missing structures of the inputs. In the second stage, based on the reconstructed structures, a texture generator using appearance flow is designed to yield image details. Experiments on multiple publicly available datasets show the superior performance of the proposed network.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Inpainting | Places2 (test) | PSNR25.77 | 68 | |
| Image Inpainting | Places2 challenge dataset (test) | PSNR29.047 | 21 | |
| Image Inpainting | CelebA v1 (test) | PSNR31.618 | 18 | |
| Image Inpainting | Places2 (0.01, 0.1] (test) | PSNR34.92 | 9 | |
| Image Inpainting | Places2 (0.1, 0.2] (test) | PSNR29.13 | 9 | |
| Image Inpainting | Places2 (0.2, 0.3] (test) | PSNR25.89 | 9 | |
| Image Inpainting | Places2 (0.3, 0.4] (test) | PSNR23.58 | 9 | |
| Image Inpainting | Places2 (0.4, 0.5] (test) | PSNR21.63 | 9 | |
| Image Inpainting | Places2 (0.5, 0.6] (test) | PSNR19.35 | 9 | |
| Image Inpainting | CelebA-HQ 1000 images with 128x128 center holes (test) | PSNR25.05 | 8 |