Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multi-View Azimuth Stereo via Tangent Space Consistency

About

We present a method for 3D reconstruction only using calibrated multi-view surface azimuth maps. Our method, multi-view azimuth stereo, is effective for textureless or specular surfaces, which are difficult for conventional multi-view stereo methods. We introduce the concept of tangent space consistency: Multi-view azimuth observations of a surface point should be lifted to the same tangent space. Leveraging this consistency, we recover the shape by optimizing a neural implicit surface representation. Our method harnesses the robust azimuth estimation capabilities of photometric stereo methods or polarization imaging while bypassing potentially complex zenith angle estimation. Experiments using azimuth maps from various sources validate the accurate shape recovery with our method, even without zenith angles.

Xu Cao, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita• 2023

Related benchmarks

TaskDatasetResultRank
Surface Normal EstimationSMVP3D (synthetic)
HEDGEHOG MAE7.06
5
Shape ReconstructionSMVP3D synthetic (test)
HEDGEHOG5.37
5
3D Shape ReconstructionRMVP3D (test)
DOG Score9.23
5
Showing 3 of 3 rows

Other info

Follow for update