Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views

About

Soft boundaries, like thin hairs, are commonly observed in natural and computer-generated imagery, but they remain challenging for 3D vision due to the ambiguous mixing of foreground and background cues. This paper introduces Guardians of the Hair (HairGuard), a framework designed to recover fine-grained soft boundary details in 3D vision tasks. Specifically, we first propose a novel data curation pipeline that leverages image matting datasets for training and design a depth fixer network to automatically identify soft boundary regions. With a gated residual module, the depth fixer refines depth precisely around soft boundaries while maintaining global depth quality, allowing plug-and-play integration with state-of-the-art depth models. For view synthesis, we perform depth-based forward warping to retain high-fidelity textures, followed by a generative scene painter that fills disoccluded regions and eliminates redundant background artifacts within soft boundaries. Finally, a color fuser adaptively combines warped and inpainted results to produce novel views with consistent geometry and fine-grained details. Extensive experiments demonstrate that HairGuard achieves state-of-the-art performance across monocular depth estimation, stereo image/video conversion, and novel view synthesis, with significant improvements in soft boundary regions.

Xiang Zhang, Yang Zhang, Lukas Mehl, Markus Gross, Christopher Schroers• 2026

Related benchmarks

TaskDatasetResultRank
Stereo Image ConversionMarvel-10K
PSNR36.59
14
Stereo ConversionMono2Stereo
PSNR33.09
14
Stereo Video ConversionMarvel-10K
PSNR36.58
8
Stereo Image ConversionMono2Stereo (test)
S-PSNR25.05
6
Stereo Video ConversionMarvel-10K (test)
S-PSNR27.1
6
Novel View SynthesisAIM-500 (test)
FID18.82
5
Novel View SynthesisP3M-10K (test)
FID21.38
5
Warping PerformanceMarvel-10K full image
PSNR27.06
3
Warping PerformanceMono2Stereo full image
PSNR29.35
3
Showing 9 of 9 rows

Other info

Follow for update