Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptation

About

The task of 3D semantic scene completion using monocular cameras is gaining significant attention in the field of autonomous driving. This task aims to predict the occupancy status and semantic labels of each voxel in a 3D scene from partial image inputs. Despite numerous existing methods, many face challenges such as inaccurately predicting object shapes and misclassifying object boundaries. To address these issues, we propose DepthSSC, an advanced method for semantic scene completion using only monocular cameras. DepthSSC integrates the Spatial Transformation Graph Fusion (ST-GF) module with Geometric-Aware Voxelization (GAV), enabling dynamic adjustment of voxel resolution to accommodate the geometric complexity of 3D space. This ensures precise alignment between spatial and depth information, effectively mitigating issues such as object boundary distortion and incorrect depth perception found in previous methods. Evaluations on the SemanticKITTI and SSCBench-KITTI-360 dataset demonstrate that DepthSSC not only captures intricate 3D structural details effectively but also achieves state-of-the-art performance.

Jiawei Yao, Jusheng Zhang, Xiaochao Pan, Tong Wu, Canran Xiao• 2023

Related benchmarks

TaskDatasetResultRank
Semantic Scene CompletionSemanticKITTI (val)
mIoU (Mean IoU)13.28
84
Semantic Scene CompletionSemanticKITTI (test)
Overall IoU44.58
48
Semantic Scene CompletionSSCBench-KITTI-360 (test)
IoU40.85
35
Semantic Scene CompletionSemanticKITTI hidden (test)
SSC mIoU0.1311
23
Semantic Scene CompletionSemanticKITTI 1.0 (test)
mIoU13.11
23
Semantic Scene CompletionSSCBench-KITTI360 18 (test)
IoU (%)40.85
6
Showing 6 of 6 rows

Other info

Follow for update