LayerGS: Decomposition and Inpainting of Layered 3D Human Avatars via 2D Gaussian Splatting
About
We propose a novel framework for decomposing arbitrarily posed humans into animatable multi-layered 3D human avatars, separating the body and garments. Conventional single-layer reconstruction methods lock clothing to one identity, while prior multi-layer approaches struggle with occluded regions. We overcome both limitations by encoding each layer as a set of 2D Gaussians for accurate geometry and photorealistic rendering, and inpainting hidden regions with a pretrained 2D diffusion model via score-distillation sampling (SDS). Our three-stage training strategy first reconstructs the coarse canonical garment via single-layer reconstruction, followed by multi-layer training to jointly recover the inner-layer body and outer-layer garment details. Experiments on two 3D human benchmark datasets (4D-Dress, Thuman2.0) show that our approach achieves better rendering quality and layer decomposition and recomposition than the previous state-of-the-art, enabling realistic virtual try-on under novel viewpoints and poses, and advancing practical creation of high-fidelity 3D human assets for immersive applications. Our code is available at https://github.com/RockyXu66/LayerGS
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Inpainting | 4D-DRESS | CLIP Score33.34 | 3 | |
| Recomposition | 4D-Dress 00122-Inner-Take8 | SSIM98.73 | 3 | |
| Recomposition | 4D-Dress 00127-Inner-Take5 | SSIM0.988 | 3 | |
| Recomposition | 4D-Dress 00152-Inner-Take4 | SSIM0.9869 | 3 | |
| Recomposition | 4D-Dress 00174-Inner-Take10 | SSIM98.66 | 3 | |
| Recomposition | 4D-Dress 00175-Inner-Take4 | SSIM0.9882 | 3 | |
| Recomposition | 4D-Dress 00190-Inner-Take2 | SSIM0.9857 | 3 | |
| Virtual Try-On | Thuman 4D-Dress 2.0 | DINO Similarity0.506 | 2 |