Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Pose Guided Person Image Generation

About

This paper proposes the novel Pose Guided Person Generation Network (PG$^2$) that allows to synthesize person images in arbitrary poses, based on an image of that person and a novel pose. Our generation framework PG$^2$ utilizes the pose information explicitly and consists of two key stages: pose integration and image refinement. In the first stage the condition image and the target pose are fed into a U-Net-like network to generate an initial but coarse image of the person with the target pose. The second stage then refines the initial and blurry result by training a U-Net-like generator in an adversarial way. Extensive experimental results on both 128$\times$64 re-identification images and 256$\times$256 fashion photos show that our model generates high-quality person images with convincing details.

Liqian Ma, Xu Jia, Qianru Sun, Bernt Schiele, Tinne Tuytelaars, Luc Van Gool• 2017

Related benchmarks

TaskDatasetResultRank
Person Image GenerationMarket-1501 (test)
SSIM0.261
25
Person Image GenerationDeepFashion (test)
SSIM0.773
19
Pose-guided Human Image GenerationMarket 1501
R2G Score11.2
13
Hand gesture-to-gesture translationSenz3D (test)
FID31.7333
11
Person Image GenerationDeepFashion--
11
Person Image SynthesisDeepFashion (test)
SSIM0.773
10
Pose TransferDeepFashion (test)
User Preference Score1.61
9
Face Reenactmentsame source
AU (%)82.7
7
Face Reenactmentcross source
AU (%)82.6
7
Face Reenactmentin the wild
AU %82.3
7
Showing 10 of 24 rows

Other info

Follow for update