Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depth

About

Single-view depth estimation suffers from the problem that a network trained on images from one camera does not generalize to images taken with a different camera model. Thus, changing the camera model requires collecting an entirely new training dataset. In this work, we propose a new type of convolution that can take the camera parameters into account, thus allowing neural networks to learn calibration-aware patterns. Experiments confirm that this improves the generalization capabilities of depth prediction networks considerably, and clearly outperforms the state of the art when the train and test images are acquired with different cameras.

Jose M. Facil, Benjamin Ummenhofer, Huizhong Zhou, Luis Montesano, Thomas Brox, Javier Civera• 2019

Related benchmarks

TaskDatasetResultRank
3D Object DetectionKITTI-360 (val)
AP3D @ IoU=0.5, Class=Car60.2
33
3D Object DetectionNuscenes to Waymo
mAP4.5
18
3D Object DetectionNuscenes to Lyft
mAP0.145
14
3D Object DetectionNuscenes Lyft -> Nuscenes
mAP9.8
8
3D Object DetectionnuScenes to Lyft v1.0 (val)
NDS*31.6
7
3D Object DetectionLyft to nuScenes v1.0-trainval (val)
NDS0.181
7
3D Object DetectionWaymo to nuScenes v1.0 (val)
NDS21.5
6
3D Object DetectionnuScenes to Waymo v1.0 (val)
NDS*0.185
6
Showing 8 of 8 rows

Other info

Follow for update