Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field

About

Realistic virtual humans play a crucial role in numerous industries, such as metaverse, intelligent healthcare, and self-driving simulation. But creating them on a large scale with high levels of realism remains a challenge. The utilization of deep implicit function sparks a new era of image-based 3D clothed human reconstruction, enabling pixel-aligned shape recovery with fine details. Subsequently, the vast majority of works locate the surface by regressing the deterministic implicit value for each point. However, should all points be treated equally regardless of their proximity to the surface? In this paper, we propose replacing the implicit value with an adaptive uncertainty distribution, to differentiate between points based on their distance to the surface. This simple ``value to distribution'' transition yields significant improvements on nearly all the baselines. Furthermore, qualitative results demonstrate that the models trained using our uncertainty distribution loss, can capture more intricate wrinkles, and realistic limbs. Code and models are available for research purposes at https://github.com/psyai-net/D-IF_release.

Xueting Yang, Yihao Luo, Yuliang Xiu, Wei Wang, Hao Xu, Zhaoxin Fan• 2023

Related benchmarks

TaskDatasetResultRank
3D human reconstructionCAPE-NFP
Chamfer Distance0.9877
58
3D human reconstructionCAPE-FP
Chamfer Distance0.8038
51
3D human reconstructionCAPE
Chamfer Dist.0.8332
40
3D human reconstructionTHuman 2.0 (test)
Chamfer Distance1.1696
24
3D human reconstructionMonocular 3D Human Reconstruction (test)
Ch. Distance2.97
15
3D Human Reconstruction (Normals Back)Monocular 3D Human Reconstruction (test)
Angular Error27.84
15
3D Human Reconstruction (Normals Front)Monocular 3D Human Reconstruction (test)
Angular Error24.52
15
3D clothed human reconstructionTHuman 2.0
Chamfer Distance1.0305
13
3D human reconstructionCAPE-NFP (test)
Chamfer Distance0.8237
8
3D human reconstructionCAPE-FP (test)
Chamfer Distance0.7625
8
Showing 10 of 10 rows

Other info

Follow for update