Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Image Inpainting with External-internal Learning and Monochromic Bottleneck

About

Although recent inpainting approaches have demonstrated significant improvements with deep neural networks, they still suffer from artifacts such as blunt structures and abrupt colors when filling in the missing regions. To address these issues, we propose an external-internal inpainting scheme with a monochromic bottleneck that helps image inpainting models remove these artifacts. In the external learning stage, we reconstruct missing structures and details in the monochromic space to reduce the learning dimension. In the internal learning stage, we propose a novel internal color propagation method with progressive learning strategies for consistent color restoration. Extensive experiments demonstrate that our proposed scheme helps image inpainting models produce more structure-preserved and visually compelling results.

Tengfei Wang, Hao Ouyang, Qifeng Chen• 2021

Related benchmarks

TaskDatasetResultRank
Image InpaintingParis Streetview
PSNR26.75
8
Image InpaintingDTD
PSNR29.38
8
GAN InversionCelebA-HQ 1500 images (test)
PSNR22.51
4
Showing 3 of 3 rows

Other info

Code

Follow for update