Human Hair Reconstruction with Strand-Aligned 3D Gaussians
About
We introduce a new hair modeling method that uses a dual representation of classical hair strands and 3D Gaussians to produce accurate and realistic strand-based reconstructions from multi-view data. In contrast to recent approaches that leverage unstructured Gaussians to model human avatars, our method reconstructs the hair using 3D polylines, or strands. This fundamental difference allows the use of the resulting hairstyles out-of-the-box in modern computer graphics engines for editing, rendering, and simulation. Our 3D lifting method relies on unstructured Gaussians to generate multi-view ground truth data to supervise the fitting of hair strands. The hairstyle itself is represented in the form of the so-called strand-aligned 3D Gaussians. This representation allows us to combine strand-based hair priors, which are essential for realistic modeling of the inner structure of hairstyles, with the differentiable rendering capabilities of 3D Gaussian Splatting. Our method, named Gaussian Haircut, is evaluated on synthetic and real scenes and demonstrates state-of-the-art performance in the task of strand-based hair reconstruction.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Hair Appearance Rendering | Synthetic Dynamic Hair Dataset (test) | PSNR26.053 | 18 | |
| 3D Head Avatar Reconstruction | Ava 256 | PSNR30.55 | 16 | |
| 3D fur geometry reconstruction | Synthetic Tiger Asset (test) | Precision (2/20)16.24 | 6 | |
| Appearance Rendering | GaussianHair Curly | PSNR30.07 | 3 | |
| Appearance Rendering | GaussianHair Short | PSNR31.03 | 3 | |
| Appearance Rendering | GaussianHair Long | PSNR27.78 | 3 | |
| End-to-end Hair Reconstruction | Hair Reconstruction Dataset | Reconstruction Time (h)15 | 3 | |
| Hair Reconstruction | Hair Reconstruction Dataset | Appearance Features Size (Mb)544 | 3 | |
| Strand Reconstruction | Hair Reconstruction Dataset | Reconstruction Time (h)11 | 3 |