Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance

About

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale diffusion models are confined to generating images of up to 1K resolution, which is far from meeting the demands of contemporary commercial applications. Directly sampling higher-resolution images often yields results marred by artifacts such as object repetition and distorted shapes. Addressing the aforementioned issues typically necessitates training or fine-tuning models on higher-resolution datasets. However, this poses a formidable challenge due to the difficulty in collecting large-scale high-resolution images and substantial computational resources. While several preceding works have proposed alternatives to bypass the cumbersome training process, they often fail to produce convincing results. In this work, we probe the generative ability of diffusion models at higher resolution beyond their original capability and propose a novel progressive approach that fully utilizes generated low-resolution images to guide the generation of higher-resolution images. Our method obviates the need for additional training or fine-tuning which significantly lowers the burden of computational costs. Extensive experiments and results validate the efficiency and efficacy of our method. Project page: https://yhyun225.github.io/DiffuseHigh/

Younghyun Kim, Geunmin Hwang, Junyu Zhang, Eunbyung Park• 2024

Related benchmarks

TaskDatasetResultRank
High-Resolution Image GenerationAesthetic-4K
IR0.93
64
Text-to-Image GenerationLAION-5B 1,000 prompts
FID (Real)48.861
20
Text-to-Image Generation4K Resolution 4K x 4K (test)
CLIP IQA Score0.4221
16
Showing 3 of 3 rows

Other info

Follow for update