Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

StructureFlow: Image Inpainting via Structure-aware Appearance Flow

About

Image inpainting techniques have shown significant improvements by using deep neural networks recently. However, most of them may either fail to reconstruct reasonable structures or restore fine-grained textures. In order to solve this problem, in this paper, we propose a two-stage model which splits the inpainting task into two parts: structure reconstruction and texture generation. In the first stage, edge-preserved smooth images are employed to train a structure reconstructor which completes the missing structures of the inputs. In the second stage, based on the reconstructed structures, a texture generator using appearance flow is designed to yield image details. Experiments on multiple publicly available datasets show the superior performance of the proposed network.

Yurui Ren, Xiaoming Yu, Ruonan Zhang, Thomas H. Li, Shan Liu, Ge Li• 2019

Related benchmarks

TaskDatasetResultRank
Image InpaintingPlaces2 (test)
PSNR25.77
68
Image InpaintingPlaces2 challenge dataset (test)
PSNR29.047
21
Image InpaintingCelebA v1 (test)
PSNR31.618
18
Image InpaintingPlaces2 (0.01, 0.1] (test)
PSNR34.92
9
Image InpaintingPlaces2 (0.1, 0.2] (test)
PSNR29.13
9
Image InpaintingPlaces2 (0.2, 0.3] (test)
PSNR25.89
9
Image InpaintingPlaces2 (0.3, 0.4] (test)
PSNR23.58
9
Image InpaintingPlaces2 (0.4, 0.5] (test)
PSNR21.63
9
Image InpaintingPlaces2 (0.5, 0.6] (test)
PSNR19.35
9
Image InpaintingCelebA-HQ 1000 images with 128x128 center holes (test)
PSNR25.05
8
Showing 10 of 12 rows

Other info

Follow for update