Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Bipartite Graph Reasoning GANs for Person Image Generation

About

We present a novel Bipartite Graph Reasoning GAN (BiGraphGAN) for the challenging person image generation task. The proposed graph generator mainly consists of two novel blocks that aim to model the pose-to-pose and pose-to-image relations, respectively. Specifically, the proposed Bipartite Graph Reasoning (BGR) block aims to reason the crossing long-range relations between the source pose and the target pose in a bipartite graph, which mitigates some challenges caused by pose deformation. Moreover, we propose a new Interaction-and-Aggregation (IA) block to effectively update and enhance the feature representation capability of both person's shape and appearance in an interactive way. Experiments on two challenging and public datasets, i.e., Market-1501 and DeepFashion, show the effectiveness of the proposed BiGraphGAN in terms of objective quantitative scores and subjective visual realness. The source code and trained models are available at https://github.com/Ha0Tang/BiGraphGAN.

Hao Tang, Song Bai, Philip H.S. Torr, Nicu Sebe• 2020

Related benchmarks

TaskDatasetResultRank
Person Image GenerationMarket-1501 (test)
SSIM0.325
25
Human Pose TransferDeepFashion In-shop Clothes Retrieval (test)
SSIM0.778
14
Pose-guided Human Image GenerationMarket 1501
R2G Score35.76
13
Person Image SynthesisDeepFashion (test)
SSIM0.778
10
Human Pose TransferMarket-1501 (test)
SSIM0.325
7
Pose-guided Human Image GenerationDeepFashion
R2G22.39
7
Pose-guided Person Image GenerationDeepFashion 8750 images (test)
FID24.36
7
Human Pose TransferDeepFashion (test)
R2G22.39
7
Showing 8 of 8 rows

Other info

Code

Follow for update