Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Trajectory Densification and Depth from Perspective-based Blur

About

In the absence of a mechanical stabilizer, the camera undergoes inevitable rotational dynamics during capturing, which induces perspective-based blur especially under long-exposure scenarios. From an optical standpoint, perspective-based blur is depth-position-dependent: objects residing at distinct spatial locations incur different blur levels even under the same imaging settings. Inspired by this, we propose a novel method that estimate metric depth by examining the blur pattern of a video stream and dense trajectory via joint optical design algorithm. Specifically, we employ off-the-shelf vision encoder and point tracker to extract video information. Then, we estimate depth map via windowed embedding and multi-window aggregation, and densify the sparse trajectory from the optical algorithm using a vision-language model. Evaluations on multiple depth datasets demonstrate that our method attains strong performance over large depth range, while maintaining favorable generalization. Relative to the real trajectory in handheld shooting settings, our optical algorithm achieves superior precision and the dense reconstruction maintains strong accuracy.

Tianchen Qiu, Qirun Zhang, Jiajian He, Zhengyue Zhuge, Jiahui Xu, Yueting Chen• 2025

Related benchmarks

TaskDatasetResultRank
Depth EstimationNYU Depth V2--
177
Depth EstimationKITTI
AbsRel0.051
92
Inter-frame Trajectory EstimationNYU-D
AbsRel0.045
10
Inter-frame Trajectory EstimationSKYScenes
AbsRel0.043
10
Inter-frame Trajectory EstimationKITTI
AbsRel0.045
10
Depth EstimationSKYScenes
AbsRel9.5
7
Showing 6 of 6 rows

Other info

Follow for update