Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

STD: Sparse-to-Dense 3D Object Detector for Point Cloud

About

We present a new two-stage 3D object detection framework, named sparse-to-dense 3D Object Detector (STD). The first stage is a bottom-up proposal generation network that uses raw point cloud as input to generate accurate proposals by seeding each point with a new spherical anchor. It achieves a high recall with less computation compared with prior works. Then, PointsPool is applied for generating proposal features by transforming their interior point features from sparse expression to compact representation, which saves even more computation time. In box prediction, which is the second stage, we implement a parallel intersection-over-union (IoU) branch to increase awareness of localization accuracy, resulting in further improved performance. We conduct experiments on KITTI dataset, and evaluate our method in terms of 3D object and Bird's Eye View (BEV) detection. Our method outperforms other state-of-the-arts by a large margin, especially on the hard set, with inference speed more than 10 FPS.

Zetong Yang, Yanan Sun, Shu Liu, Xiaoyong Shen, Jiaya Jia• 2019

Related benchmarks

TaskDatasetResultRank
3D Object DetectionKITTI car (test)
AP3D (Easy)87.95
195
3D Object DetectionKITTI (val)
AP3D (Moderate)79.8
85
3D Object DetectionKITTI (test)
AP_3D (Easy)86.61
83
3D Object DetectionKITTI Pedestrian (test)
AP3D (Easy)53.08
63
Bird's Eye View DetectionKITTI Car class official (test)
AP (Easy)94.74
62
3D Object DetectionKITTI car (val)
AP 3D Easy89.7
62
3D Object DetectionKITTI (test)
3D AP Easy87.95
61
3D Object DetectionKITTI (test)
AP_3D Car (Easy)87.95
60
3D Object DetectionKITTI Cyclist (test)
AP3D Easy78.89
49
3D Object DetectionKITTI cars (val)
AP Easy89.7
48
Showing 10 of 32 rows

Other info

Follow for update