Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Fast Point Cloud Generation with Straight Flows

About

Diffusion models have emerged as a powerful tool for point cloud generation. A key component that drives the impressive performance for generating high-quality samples from noise is iteratively denoise for thousands of steps. While beneficial, the complexity of learning steps has limited its applications to many 3D real-world. To address this limitation, we propose Point Straight Flow (PSF), a model that exhibits impressive performance using one step. Our idea is based on the reformulation of the standard diffusion model, which optimizes the curvy learning trajectory into a straight path. Further, we develop a distillation strategy to shorten the straight path into one step without a performance loss, enabling applications to 3D real-world with latency constraints. We perform evaluations on multiple 3D tasks and find that our PSF performs comparably to the standard diffusion model, outperforming other efficient 3D point cloud generation methods. On real-world applications such as point cloud completion and training-free text-guided generation in a low-latency setup, PSF performs favorably.

Lemeng Wu, Dilin Wang, Chengyue Gong, Xingchao Liu, Yunyang Xiong, Rakesh Ranjan, Raghuraman Krishnamoorthi, Vikas Chandra, Qiang Liu• 2022

Related benchmarks

TaskDatasetResultRank
Point cloud generationShapeNet Car
1-NNA (CD)57.19
41
3D Shape GenerationShapeNet airplane
1-NNA (CD)71.11
30
Point Cloud CompletionShapeNet (test)
EMD (Airplane)1.004
26
Point cloud generationShapeNet chair
1-NNA (CD)58.92
23
3D Shape GenerationShapeNet chair
1-NN Accuracy (CD)58.92
18
Shape GenerationShapeNet airplane
MMD (CD)0.221
11
Shape GenerationShapeNet Car
MMD (CD)1.023
11
Shape GenerationShapeNet chair
MMD (CD)2.624
11
Point cloud generationShapeNet airplane
1-NNA (CD)71.11
10
Unconditional 3D Point Cloud GenerationShapeNet Airplane v1 (test)
MMD (CD)0.2205
8
Showing 10 of 15 rows

Other info

Follow for update