Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Shadow Generation with Decomposed Mask Prediction and Attentive Shadow Filling

About

Image composition refers to inserting a foreground object into a background image to obtain a composite image. In this work, we focus on generating plausible shadows for the inserted foreground object to make the composite image more realistic. To supplement the existing small-scale dataset, we create a large-scale dataset called RdSOBA with rendering techniques. Moreover, we design a two-stage network named DMASNet with decomposed mask prediction and attentive shadow filling. Specifically, in the first stage, we decompose shadow mask prediction into box prediction and shape prediction. In the second stage, we attend to reference background shadow pixels to fill the foreground shadow. Abundant experiments prove that our DMASNet achieves better visual effects and generalizes well to real composite images.

Xinhao Tao, Junyan Cao, Yan Hong, Li Niu• 2023

Related benchmarks

TaskDatasetResultRank
Shadow GenerationDESOBA BOS V2 (test)
GRMSE8.256
15
Shadow GenerationDESOBA BOS-free v2 (test)
GRMSE18.725
15
Single-object shadow generationDESOBA v2 (test)
GR18.725
12
Image HarmonizationDESOBA BOS V2 (test)
GR8.256
8
Image HarmonizationDESOBA BOS-free v2 (test)
GR18.725
8
Multi-Object Shadow GenerationDESOBA BOS Multi-Object v2 (test)
GR10.125
6
Multi-Object Shadow GenerationDESOBA BOS-free Multi-Object v2 (test)
GR21.583
6
Shadow GenerationReal Composite Images Single-Object
Bradley-Terry Score0.353
6
Shadow GenerationReal Composite Images Multi-Object
Bradley-Terry Score0.189
6
Showing 9 of 9 rows

Other info

Follow for update