OmniStyle: Filtering High Quality Style Transfer Data at Scale
About
In this paper, we introduce OmniStyle-1M, a large-scale paired style transfer dataset comprising over one million content-style-stylized image triplets across 1,000 diverse style categories, each enhanced with textual descriptions and instruction prompts. We show that OmniStyle-1M can not only enable efficient and scalable of style transfer models through supervised training but also facilitate precise control over target stylization. Especially, to ensure the quality of the dataset, we introduce OmniFilter, a comprehensive style transfer quality assessment framework, which filters high-quality triplets based on content preservation, style consistency, and aesthetic appeal. Building upon this foundation, we propose OmniStyle, a framework based on the Diffusion Transformer (DiT) architecture designed for high-quality and efficient style transfer. This framework supports both instruction-guided and image-guided style transfer, generating high resolution outputs with exceptional detail. Extensive qualitative and quantitative evaluations demonstrate OmniStyle's superior performance compared to existing approaches, highlighting its efficiency and versatility. OmniStyle-1M and its accompanying methodologies provide a significant contribution to advancing high-quality style transfer, offering a valuable resource for the research community.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| reference-guided style transfer | OmniConsistency-Bench | FID130.4 | 20 | |
| Style Transfer | CSG-Bench | FID129.8 | 20 | |
| Affective Image Stylization | EmoEdit (inference) | CLIP Score0.71 | 11 | |
| Image Editing | our dataset film-grey style | PSNR15.91 | 11 | |
| Image Editing | film-dream-blue style | PSNR12.55 | 11 | |
| Style Editing | Style Editing Dataset isp style | PSNR14.14 | 11 | |
| Style Editing | StyleQoRA lomo style (test) | PSNR11.11 | 11 | |
| Controllable Style Generation | CSG-Bench Text-guided | Content Preference Rate1.8 | 9 | |
| Controllable Style Generation | CSG-Bench Reference-guided | Content Preference Rate2 | 9 | |
| Image Stylization | Custom Triplet Dataset 21 styles (test) | CLIP Score65.39 | 9 |