Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videos

About

Despite recent progress in 3D hand reconstruction from monocular videos, most existing methods rely on data captured in well-controlled environments and therefore degrade in real-world settings with severe perturbations, such as hand-object interactions, extreme poses, illumination changes, and motion blur. To tackle these issues, we introduce WildGHand, an optimization-based framework that enables self-adaptive 3D Gaussian splatting on in-the-wild videos and produces high-fidelity hand avatars. WildGHand incorporates two key components: (i) a dynamic perturbation disentanglement module that explicitly represents perturbations as time-varying biases on 3D Gaussian attributes during optimization, and (ii) a perturbation-aware optimization strategy that generates per-frame anisotropic weighted masks to guide optimization. Together, these components allow the framework to identify and suppress perturbations across both spatial and temporal dimensions. We further curate a dataset of monocular hand videos captured under diverse perturbations to benchmark in-the-wild hand avatar reconstruction. Extensive experiments on this dataset and two public datasets demonstrate that WildGHand achieves state-of-the-art performance and substantially improves over its base model across multiple metrics (e.g., up to a $15.8\%$ relative gain in PSNR and a $23.1\%$ relative reduction in LPIPS). Our implementation and dataset are available at https://github.com/XuanHuang0/WildGHand.

Hanhui Li, Xuan Huang, Wanquan Liu, Yuhao Cheng, Long Chen, Yiqiang Yan, Xiaodan Liang, Chenqiang Gao• 2026

Related benchmarks

TaskDatasetResultRank
Hand Avatar RenderingWildGHand Single (test)
PSNR26.24
4
Hand Avatar RenderingWildGHand Inter. (test)
PSNR26.29
3
Hand Avatar RenderingInterHand2.6M Inter. (test)
PSNR28.25
3
Hand Avatar RenderingAnchorCrafter Inter. (test)
PSNR27.68
3
Hand ReconstructionOnline videos
PSNR27.39
3
Hand Avatar ReconstructionCollected in-the-wild dataset
PSNR29.5859
2
Showing 6 of 6 rows

Other info

Follow for update