Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Accurate Point Cloud Registration with Robust Optimal Transport

About

This work investigates the use of robust optimal transport (OT) for shape matching. Specifically, we show that recent OT solvers improve both optimization-based and deep learning methods for point cloud registration, boosting accuracy at an affordable computational cost. This manuscript starts with a practical overview of modern OT theory. We then provide solutions to the main difficulties in using this framework for shape matching. Finally, we showcase the performance of transport-enhanced registration models on a wide range of challenging tasks: rigid registration for partial shapes; scene flow estimation on the Kitti dataset; and nonparametric registration of lung vascular trees between inspiration and expiration. Our OT-based methods achieve state-of-the-art results on Kitti and for the challenging lung registration task, both in terms of accuracy and scalability. We also release PVT1010, a new public dataset of 1,010 pairs of lung vascular trees with densely sampled points. This dataset provides a challenging use case for point cloud registration algorithms with highly complex shapes and deformations. Our work demonstrates that robust OT enables fast pre-alignment and fine-tuning for a wide range of registration models, thereby providing a new key method for the computer vision toolbox. Our code and dataset are available online at: https://github.com/uncbiag/robot.

Zhengyang Shen, Jean Feydy, Peirong Liu, Ariel Hern\'an Curiale, Ruben San Jose Estepar, Raul San Jose Estepar, Marc Niethammer• 2021

Related benchmarks

TaskDatasetResultRank
Point cloud registrationModelNet40 (Unseen categories)
RMSE (Rotation)2.989
36
3D Scene FlowKITTI (test)
EPE 3D2.23
18
Point cloud registrationPVT def -> 2-scale rnd. field
TRE2.86
13
3D registrationDirLab landmarks 3,000 expert-annotated (test)
Average Error (mm)2.86
12
Showing 4 of 4 rows

Other info

Code

Follow for update