Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Deep Image Harmonization

About

Compositing is one of the most common operations in photo editing. To generate realistic composites, the appearances of foreground and background need to be adjusted to make them compatible. Previous approaches to harmonize composites have focused on learning statistical relationships between hand-crafted appearance features of the foreground and background, which is unreliable especially when the contents in the two layers are vastly different. In this work, we propose an end-to-end deep convolutional neural network for image harmonization, which can capture both the context and semantic information of the composite images during harmonization. We also introduce an efficient way to collect large-scale and high-quality training data that can facilitate the training process. Experiments on the synthesized dataset and real composite images show that the proposed network outperforms previous state-of-the-art methods.

Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, Ming-Hsuan Yang• 2017

Related benchmarks

TaskDatasetResultRank
Image HarmonizationiHarmony4 HFlickr
MSE163.4
58
Image HarmonizationiHarmony4 (all)
MSE76.77
53
Image HarmonizationiHarmony4 Hday2night
MSE82.34
51
Image HarmonizationiHarmony4 HAdobe5k
MSE92.65
43
Image HarmonizationiHarmony4 HCOCO
MSE51.85
38
Image HarmonizationHAdobe5k iHarmony4 (test)
MSE92.7
37
Image HarmonizationiHarmony4
MSE76.77
27
Image HarmonizationS-Adobe5K (test)
MSE92.65
25
Image HarmonizationiHarmony4 HCOCO
MSE51.85
20
Image Harmonization99 real composite images (test)
B-T Score0.948
12
Showing 10 of 29 rows

Other info

Follow for update