Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstruction

About

We present a large-scale facial UV-texture dataset that contains over 50,000 high-quality texture UV-maps with even illuminations, neutral expressions, and cleaned facial regions, which are desired characteristics for rendering realistic 3D face models under different lighting conditions. The dataset is derived from a large-scale face image dataset namely FFHQ, with the help of our fully automatic and robust UV-texture production pipeline. Our pipeline utilizes the recent advances in StyleGAN-based facial image editing approaches to generate multi-view normalized face images from single-image inputs. An elaborated UV-texture extraction, correction, and completion procedure is then applied to produce high-quality UV-maps from the normalized face images. Compared with existing UV-texture datasets, our dataset has more diverse and higher-quality texture maps. We further train a GAN-based texture decoder as the nonlinear texture basis for parametric fitting based 3D face reconstruction. Experiments show that our method improves the reconstruction accuracy over state-of-the-art approaches, and more importantly, produces high-quality texture maps that are ready for realistic renderings. The dataset, code, and pre-trained texture decoder are publicly available at https://github.com/csbhr/FFHQ-UV.

Haoran Bai, Di Kang, Haoxian Zhang, Jinshan Pan, Linchao Bao• 2022

Related benchmarks

TaskDatasetResultRank
3D Face ReconstructionREALY
Nose Error1.557
10
3D Face SynthesisVoxceleb 2 (video sequences (Target))
PSNR24.35
6
3D Face SynthesisVoxceleb2 single images Target
PSNR25.03
6
Texture RecoveryImages with Diverse Shadows 100 images
PSNR24
6
3D Face ReconstructionVoxceleb2 video sequences (Source)
PSNR29.7
6
3D Face ReconstructionVoxceleb2 single images Source
PSNR28.72
6
Face ReconstructionImages with Diverse Shadows 100 images
PSNR26.93
6
3D Face ReconstructionFFHQ and FaceScape original and variants (test)
ID Std Dev (%)90.01
5
3D Face ReconstructionREALY
Similarity0.7818
4
UV-map Illumination Quality AssessmentFFHQ-UV 1.0
BS Error7.293
2
Showing 10 of 11 rows

Other info

Code

Follow for update