Accelerated Likelihood Maximization for Diffusion-based Versatile Content Generation
About
Generating diverse, coherent, and plausible content from partially given inputs remains a fundamental challenge for diffusion models. Existing approaches face clear limitations: training-based approaches offer strong task-specific results but require costly computation, and they generalize poorly across tasks. Training-free approaches offer better efficiency, but they do not explicitly optimize over unobserved variables, leading to globally inconsistent results. To address these limitations, we introduce Accelerated Likelihood Maximization (ALM), a novel training-free sampling strategy integrated into the reverse diffusion process that significantly extends the applicability of diffusion models beyond simple generation tasks. Unlike previous methods that implicitly influence missing regions through pre-generated region constraints, we directly optimize the unobserved region during the sampling process, enabling globally coherent and plausible generation. Furthermore, we incorporate an acceleration strategy that significantly improves computational efficiency without sacrificing performance. Experimental results demonstrate that ALM consistently outperforms state-of-the-art methods in various data domains and tasks, establishing a powerful paradigm for versatile content generation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Inpainting | AFHQ 9 (test) | LPIPS0.254 | 13 | |
| Image Inpainting | CelebA-HQ 24 (test) | LPIPS0.24 | 13 | |
| Image Inpainting | Seasons | LPIPS0.271 | 9 | |
| Image Inpainting | Painters (1,000 image–mask pairs) | LPIPS0.275 | 9 | |
| 3D mesh texturing | Objaverse (test) | FID155.5 | 7 | |
| Human Motion Completion | HumanML3D First-half completion (test) | FID0.311 | 6 | |
| Human Motion Completion | HumanML3D Middle-half completion (test) | FID0.447 | 6 | |
| Human Motion Completion | HumanML3D Last-half completion (test) | FID0.236 | 6 | |
| Long Video Generation | Long Video Generation | FVD2.215 | 4 | |
| Wide image generation | Wide image generation | FID83.41 | 4 |