Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integration

About

Text-guided image generation has advanced rapidly with large-scale diffusion models, yet achieving precise stylization with visual exemplars remains difficult. Existing approaches often depend on task-specific retraining or expensive inversion procedures, which can compromise content integrity, reduce style fidelity, and lead to an unsatisfactory trade-off between semantic prompt adherence and style alignment. In this work, we introduce a training-free framework that reformulates style-guided synthesis as an in-context learning task. Guided by textual semantic prompts, our method concatenates a reference style image with a masked target image, leveraging a pretrained ReFlow-based inpainting model to seamlessly integrate semantic content with the desired style through multimodal attention fusion. We further analyze the imbalance and noise sensitivity inherent in multimodal attention fusion and propose a Dynamic Semantic-Style Integration (DSSI) mechanism that reweights attention between textual semantic and style visual tokens, effectively resolving guidance conflicts and enhancing output coherence. Experiments show that our approach achieves high-fidelity stylization with superior semantic-style balance and visual quality, offering a simple yet powerful alternative to complex, artifact-prone prior methods.

Yingying Deng, Xiangyu He, Fan Tang, Weiming Dong, Xucheng Yin• 2026

Related benchmarks

TaskDatasetResultRank
Image Style TransferUser Study
Overall Quality Score83.4
30
Style TransferCIFAR-100 and InstaStyle (test)
Content Score28.7
9
Showing 2 of 2 rows

Other info

Follow for update