Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

XingGAN for Person Image Generation

About

We propose a novel Generative Adversarial Network (XingGAN or CrossingGAN) for person image generation tasks, i.e., translating the pose of a given person to a desired one. The proposed Xing generator consists of two generation branches that model the person's appearance and shape information, respectively. Moreover, we propose two novel blocks to effectively transfer and update the person's shape and appearance embeddings in a crossing way to mutually improve each other, which has not been considered by any other existing GAN-based image generation work. Extensive experiments on two challenging datasets, i.e., Market-1501 and DeepFashion, demonstrate that the proposed XingGAN advances the state-of-the-art performance both in terms of objective quantitative scores and subjective visual realness. The source code and trained models are available at https://github.com/Ha0Tang/XingGAN.

Hao Tang, Song Bai, Li Zhang, Philip H.S. Torr, Nicu Sebe• 2020

Related benchmarks

TaskDatasetResultRank
Person Image GenerationMarket-1501 (test)
SSIM0.313
25
Person Image GenerationDeepFashion (test)
SSIM0.778
19
Human Pose TransferDeepFashion In-shop Clothes Retrieval (test)
SSIM0.778
14
Pose-guided Human Image GenerationMarket 1501
R2G Score35.28
13
Person Image GenerationDeepFashion--
11
Human Pose TransferMarket-1501 (test)
SSIM0.313
7
Human Pose TransferDeepFashion (test)
R2G21.61
7
Pose-guided Person Image GenerationDeepFashion 8750 images (test)
FID41.79
7
Showing 8 of 8 rows

Other info

Code

Follow for update