Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Human Hair Reconstruction with Strand-Aligned 3D Gaussians

About

We introduce a new hair modeling method that uses a dual representation of classical hair strands and 3D Gaussians to produce accurate and realistic strand-based reconstructions from multi-view data. In contrast to recent approaches that leverage unstructured Gaussians to model human avatars, our method reconstructs the hair using 3D polylines, or strands. This fundamental difference allows the use of the resulting hairstyles out-of-the-box in modern computer graphics engines for editing, rendering, and simulation. Our 3D lifting method relies on unstructured Gaussians to generate multi-view ground truth data to supervise the fitting of hair strands. The hairstyle itself is represented in the form of the so-called strand-aligned 3D Gaussians. This representation allows us to combine strand-based hair priors, which are essential for realistic modeling of the inner structure of hairstyles, with the differentiable rendering capabilities of 3D Gaussian Splatting. Our method, named Gaussian Haircut, is evaluated on synthetic and real scenes and demonstrates state-of-the-art performance in the task of strand-based hair reconstruction.

Egor Zakharov, Vanessa Sklyarova, Michael Black, Giljoo Nam, Justus Thies, Otmar Hilliges• 2024

Related benchmarks

TaskDatasetResultRank
Hair Appearance RenderingSynthetic Dynamic Hair Dataset (test)
PSNR26.053
18
3D Head Avatar ReconstructionAva 256
PSNR30.55
16
3D fur geometry reconstructionSynthetic Tiger Asset (test)
Precision (2/20)16.24
6
Appearance RenderingGaussianHair Curly
PSNR30.07
3
Appearance RenderingGaussianHair Short
PSNR31.03
3
Appearance RenderingGaussianHair Long
PSNR27.78
3
End-to-end Hair ReconstructionHair Reconstruction Dataset
Reconstruction Time (h)15
3
Hair ReconstructionHair Reconstruction Dataset
Appearance Features Size (Mb)544
3
Strand ReconstructionHair Reconstruction Dataset
Reconstruction Time (h)11
3
Showing 9 of 9 rows

Other info

Follow for update