Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AIComposer: Any Style and Content Image Composition via Feature Integration

About

Image composition has advanced significantly with large-scale pre-trained T2I diffusion models. Despite progress in same-domain composition, cross-domain composition remains under-explored. The main challenges are the stochastic nature of diffusion models and the style gap between input images, leading to failures and artifacts. Additionally, heavy reliance on text prompts limits practical applications. This paper presents the first cross-domain image composition method that does not require text prompts, allowing natural stylization and seamless compositions. Our method is efficient and robust, preserving the diffusion prior, as it involves minor steps for backward inversion and forward denoising without training the diffuser. Our method also uses a simple multilayer perceptron network to integrate CLIP features from foreground and background, manipulating diffusion with a local cross-attention strategy. It effectively preserves foreground content while enabling stable stylization without a pre-stylization network. Finally, we create a benchmark dataset with diverse contents and styles for fair evaluation, addressing the lack of testing datasets for cross-domain image composition. Our method outperforms state-of-the-art techniques in both qualitative and quantitative evaluations, significantly improving the LPIPS score by 30.5% and the CSD metric by 18.1%. We believe our method will advance future research and applications. Code and benchmark at https://github.com/sherlhw/AIComposer.

Haowen Li, Zhenfeng Fan, Zhang Wen, Zhengzhou Zhu, Yunjin Li• 2025

Related benchmarks

TaskDatasetResultRank
Cross-domain object insertionAIComposer
CLIP-I85.75
21
Cross-domain compositingTF-ICON
LPIPS0.4966
15
Cross-domain compositingTF-ICON & AIComposer Pooled
Identity Score2.4
15
Image CompositingTF-ICON (test)
LPIPS0.4966
13
Image CompositingAIComposer
LPIPS0.4648
8
Stylized Object InsertionInsert In Style Bench
CLIP-I0.768
6
In-domain object compositionAnyDoor
CLIP-I Score0.772
6
Object CompositionSubjectPlop
CLIP-I81.4
6
Cross-domain compositingChameleon (ev)
Identity Score23.8
3
Showing 9 of 9 rows

Other info

Follow for update