Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BargainNet: Background-Guided Domain Translation for Image Harmonization

About

Image composition is a fundamental operation in image editing field. However, unharmonious foreground and background downgrade the quality of composite image. Image harmonization, which adjusts the foreground to improve the consistency, is an essential yet challenging task. Previous deep learning based methods mainly focus on directly learning the mapping from composite image to real image, while ignoring the crucial guidance role that background plays. In this work, with the assumption that the foreground needs to be translated to the same domain as background, we formulate image harmonization task as background-guided domain translation. Therefore, we propose an image harmonization network with a novel domain code extractor and well-tailored triplet losses, which could capture the background domain information to guide the foreground harmonization. Extensive experiments on the existing image harmonization benchmark demonstrate the effectiveness of our proposed method. Code is available at https://github.com/bcmi/BargainNet.

Wenyan Cong, Li Niu, Jianfu Zhang, Jing Liang, Liqing Zhang• 2020

Related benchmarks

TaskDatasetResultRank
Image HarmonizationiHarmony4 HFlickr
MSE97.32
58
Image HarmonizationiHarmony4 (all)
MSE37.82
53
Image HarmonizationiHarmony4 Hday2night
MSE50.98
51
Image HarmonizationiHarmony4 HAdobe5k
MSE39.94
43
Image HarmonizationiHarmony4 HCOCO
MSE24.84
38
Image HarmonizationHAdobe5k iHarmony4 (test)
MSE39.9
37
Image HarmonizationiHarmony4
MSE37.82
27
Image HarmonizationS-Adobe5K (test)
MSE39.94
25
Image HarmonizationiHarmony4 HCOCO
MSE24.84
20
Image HarmonizationDIH99 (test)
Average Processing Time (s)0.21
17
Showing 10 of 32 rows

Other info

Code

Follow for update