An Improved Method for Personalizing Diffusion Models
About
Diffusion models have demonstrated impressive image generation capabilities. Personalized approaches, such as textual inversion and Dreambooth, enhance model individualization using specific images. These methods enable generating images of specific objects based on diverse textual contexts. Our proposed approach aims to retain the model's original knowledge during new information integration, resulting in superior outcomes while necessitating less training time compared to Dreambooth and textual inversion.
Yan Zeng, Masanori Suganuma, Takayuki Okatani• 2024
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Subject-driven Text-to-Image Generation | DreamBooth Diverse Prompt | CLIP Score0.8 | 2 | |
| Subject-driven Text-to-Image Generation | DreamBooth Simple Prompt | CLIP Score0.859 | 2 |
Showing 2 of 2 rows