Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Consistency Flow Matching: Defining Straight Flows with Velocity Consistency

About

Flow matching (FM) is a general framework for defining probability paths via Ordinary Differential Equations (ODEs) to transform between noise and data samples. Recent approaches attempt to straighten these flow trajectories to generate high-quality samples with fewer function evaluations, typically through iterative rectification methods or optimal transport solutions. In this paper, we introduce Consistency Flow Matching (Consistency-FM), a novel FM method that explicitly enforces self-consistency in the velocity field. Consistency-FM directly defines straight flows starting from different times to the same endpoint, imposing constraints on their velocity values. Additionally, we propose a multi-segment training approach for Consistency-FM to enhance expressiveness, achieving a better trade-off between sampling quality and speed. Preliminary experiments demonstrate that our Consistency-FM significantly improves training efficiency by converging 4.4x faster than consistency models and 1.7x faster than rectified flow models while achieving better generation quality. Our code is available at: https://github.com/YangLing0818/consistency_flow_matching

Ling Yang, Zixiang Zhang, Zhilong Zhang, Xingchao Liu, Minkai Xu, Wentao Zhang, Chenlin Meng, Stefano Ermon, Bin Cui• 2024

Related benchmarks

TaskDatasetResultRank
Unconditional Image GenerationCIFAR-10
FID5.34
240
Robotic ManipulationRoboTwin 2.0 (test)
Average Success Rate74.3
22
LiftRoboMimic
Success Rate100
11
Beat Block HammerRoboTwin 2.0 (test)
Success Rate82
5
Adjust BottleRoboTwin 2.0 (test)
Success Rate85.3
5
Place empty cupRoboTwin 2.0 (test)
Success Rate74.7
5
Showing 6 of 6 rows

Other info

Follow for update