Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SDXL-Lightning: Progressive Adversarial Diffusion Distillation

About

We propose a diffusion distillation method that achieves new state-of-the-art in one-step/few-step 1024px text-to-image generation based on SDXL. Our method combines progressive and adversarial distillation to achieve a balance between quality and mode coverage. In this paper, we discuss the theoretical analysis, discriminator design, model formulation, and training techniques. We open-source our distilled SDXL-Lightning models both as LoRA and full UNet weights.

Shanchuan Lin, Anran Wang, Xiao Yang• 2024

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationGenEval
Overall Score53
506
Text-to-Image GenerationGenEval
GenEval Score53.32
360
Text-to-Image GenerationGenEval (test)
Two Obj. Acc61
221
Text-to-Image GenerationCOCO 30k
FID24.46
53
Text-to-Image GenerationHPSv2
HPSv2 Score32.18
35
Text-to-Image GenerationCOCO 2014 (val)--
34
Text-to-Image GenerationCOCO 5k
CLIP Score0.3214
19
Text-to-Image GenerationGenEval
GE Score53.5
18
Text-to-Image GenerationCompBench
CompBench Score0.4445
12
Text-to-Image GenerationSDXL
FID28.48
10
Showing 10 of 18 rows

Other info

Follow for update