Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models

About

Editing real images using a pre-trained text-to-image (T2I) diffusion/flow model often involves inverting the image into its corresponding noise map. However, inversion by itself is typically insufficient for obtaining satisfactory results, and therefore many methods additionally intervene in the sampling process. Such methods achieve improved results but are not seamlessly transferable between model architectures. Here, we introduce FlowEdit, a text-based editing method for pre-trained T2I flow models, which is inversion-free, optimization-free and model agnostic. Our method constructs an ODE that directly maps between the source and target distributions (corresponding to the source and target text prompts) and achieves a lower transport cost than the inversion approach. This leads to state-of-the-art results, as we illustrate with Stable Diffusion 3 and FLUX. Code and examples are available on the project's webpage.

Vladimir Kulikov, Matan Kleiner, Inbar Huberman-Spiegelglas, Tomer Michaeli• 2024

Related benchmarks

TaskDatasetResultRank
Image EditingPIE-Bench
PSNR32.68
116
Image EditingPIE-Bench (test)
PSNR22.22
46
Image EditingPIE-Bench
Distance 10312.34
17
Image EditingEditEval v2
LPIPS0.3921
14
Image Editing1024 x 1024 resolution
Runtime (4090, s)101.1
14
Image EditingSNR-Bench 1.0 (test)
Reward Model Structural Score3.38
12
Image EditingReshapeBench
AS6.42
10
Text-Guided Image EditingPIE-Bench (test)
Structure Distance2.28e+4
8
3D EditingEval3DEdit (test)
Action Change (Uni3Dpc)0.4701
7
3D Editing3D Editing
Time (s)25.77
7
Showing 10 of 20 rows

Other info

Follow for update