Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views
About
Soft boundaries, like thin hairs, are commonly observed in natural and computer-generated imagery, but they remain challenging for 3D vision due to the ambiguous mixing of foreground and background cues. This paper introduces Guardians of the Hair (HairGuard), a framework designed to recover fine-grained soft boundary details in 3D vision tasks. Specifically, we first propose a novel data curation pipeline that leverages image matting datasets for training and design a depth fixer network to automatically identify soft boundary regions. With a gated residual module, the depth fixer refines depth precisely around soft boundaries while maintaining global depth quality, allowing plug-and-play integration with state-of-the-art depth models. For view synthesis, we perform depth-based forward warping to retain high-fidelity textures, followed by a generative scene painter that fills disoccluded regions and eliminates redundant background artifacts within soft boundaries. Finally, a color fuser adaptively combines warped and inpainted results to produce novel views with consistent geometry and fine-grained details. Extensive experiments demonstrate that HairGuard achieves state-of-the-art performance across monocular depth estimation, stereo image/video conversion, and novel view synthesis, with significant improvements in soft boundary regions.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Stereo Image Conversion | Marvel-10K | PSNR36.59 | 14 | |
| Stereo Conversion | Mono2Stereo | PSNR33.09 | 14 | |
| Stereo Video Conversion | Marvel-10K | PSNR36.58 | 8 | |
| Stereo Image Conversion | Mono2Stereo (test) | S-PSNR25.05 | 6 | |
| Stereo Video Conversion | Marvel-10K (test) | S-PSNR27.1 | 6 | |
| Novel View Synthesis | AIM-500 (test) | FID18.82 | 5 | |
| Novel View Synthesis | P3M-10K (test) | FID21.38 | 5 | |
| Warping Performance | Marvel-10K full image | PSNR27.06 | 3 | |
| Warping Performance | Mono2Stereo full image | PSNR29.35 | 3 |