When Test-Time Guidance Is Enough: Fast Image and Video Editing with Diffusion Guidance
About
Text-driven image and video editing can be naturally cast as inpainting problems, where masked regions are reconstructed to remain consistent with both the observed content and the editing prompt. Recent advances in test-time guidance for diffusion and flow models provide a principled framework for this task; however, existing methods rely on costly vector--Jacobian product (VJP) computations to approximate the intractable guidance term, limiting their practical applicability. Building upon the recent work of Moufad et al. (2025), we provide theoretical insights into their VJP-free approximation and substantially extend their empirical evaluation to large-scale image and video editing benchmarks. Our results demonstrate that test-time guidance alone can achieve performance comparable to, and in some cases surpass, training-based methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Video Editing | VPBench (test) | CLIP Score26.24 | 13 | |
| Image Editing | HumanEdit 1024px | FID30.8 | 12 | |
| Image Editing | InpaintCOCO 512px | FID41.9 | 12 | |
| Image Editing | InpaintCOCO 512px (test) | FID40.9 | 5 | |
| Image Editing | HumanEdit 1024px (test) | FID30.3 | 5 |