Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

About

3D single object tracking (3D SOT) in LiDAR point clouds plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance matching. However, LiDAR point clouds are usually textureless and incomplete, which hinders effective appearance matching. Besides, previous methods greatly overlook the critical motion clues among targets. In this work, beyond 3D Siamese tracking, we introduce a motion-centric paradigm to handle 3D SOT from a new perspective. Following this paradigm, we propose a matching-free two-stage tracker M^2-Track. At the 1^st-stage, M^2-Track localizes the target within successive frames via motion transformation. Then it refines the target box through motion-assisted shape completion at the 2^nd-stage. Extensive experiments confirm that M^2-Track significantly outperforms previous state-of-the-arts on three large-scale datasets while running at 57FPS (~8%, ~17%, and ~22%) precision gains on KITTI, NuScenes, and Waymo Open Dataset respectively). Further analysis verifies each component's effectiveness and shows the motion-centric paradigm's promising potential when combined with appearance matching.

Chaoda Zheng, Xu Yan, Haiming Zhang, Baoyuan Wang, Shenghui Cheng, Shuguang Cui, Zhen Li• 2022

Related benchmarks

TaskDatasetResultRank
3D Single Object TrackingKITTI (test)
Success (Car)65.5
58
3D Single Object TrackingnuScenes (val)
Success (Car)55.85
22
3D Single Object TrackingnuScenes Car category
FPS51.2
12
3D Single Object TrackingWaymo Open Dataset (val)
Success (Vehicle)61.1
12
3D Point Cloud Object TrackingWaymo Open Dataset (WOD) Vehicle (val)
Success Rate (Easy)68.1
10
3D Point Cloud Object TrackingWaymo Open Dataset (WOD) Overall (val)
Success44.6
10
3D Point Cloud Object TrackingWaymo Open Dataset (WOD) Pedestrian (val)
Success (Easy)35.5
10
3D Point Cloud TrackingKITTI Van
Success Rate53.8
10
3D Single Object TrackingNuScenes standard (test)
Success (Car)55.9
7
Showing 9 of 9 rows

Other info

Code

Follow for update