Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PPFNet: Global Context Aware Local Features for Robust 3D Point Matching

About

We present PPFNet - Point Pair Feature NETwork for deeply learning a globally informed 3D local feature descriptor to find correspondences in unorganized point clouds. PPFNet learns local descriptors on pure geometry and is highly aware of the global context, an important cue in deep learning. Our 3D representation is computed as a collection of point-pair-features combined with the points and normals within a local vicinity. Our permutation invariant network design is inspired by PointNet and sets PPFNet to be ordering-free. As opposed to voxelization, our method is able to consume raw point clouds to exploit the full sparsity. PPFNet uses a novel $\textit{N-tuple}$ loss and architecture injecting the global information naturally into the local descriptor. It shows that context awareness also boosts the local feature representation. Qualitative and quantitative evaluations of our network suggest increased recall, improved robustness and invariance as well as a vital step in the 3D descriptor extraction performance.

Haowen Deng, Tolga Birdal, Slobodan Ilic• 2018

Related benchmarks

TaskDatasetResultRank
Point cloud registration3DMatch (test)--
339
Feature Matching3DMatch (Origin)
STD10.8
33
6D Object Pose EstimationT-LESS BOP challenge protocol PrimeSense (test)
VSD49
20
Descriptor matching3DMatch Rotated
STD0.5
18
Local Descriptor Matching3DMatch 1.0 (test)
Kitchen Scene Performance89.72
18
3D local descriptor matching3DMatch
Average Recall62.3
16
6D Object Pose EstimationT-LESS Single Instance Single Object
e_VSD0.49
15
Feature Matching3DMatch
FMR (tau_2=0.05)62.3
15
Feature Matching3DMatch Rotated (test)
FMR0.003
12
3D Fragment Matching3DMatch (test)
Kitchen Success Rate89.72
9
Showing 10 of 16 rows

Other info

Follow for update