Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Generative Adversarial Text to Image Synthesis

About

Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed to learn discriminative text feature representations. Meanwhile, deep convolutional generative adversarial networks (GANs) have begun to generate highly compelling images of specific categories, such as faces, album covers, and room interiors. In this work, we develop a novel deep architecture and GAN formulation to effectively bridge these advances in text and image model- ing, translating visual concepts from characters to pixels. We demonstrate the capability of our model to generate plausible images of birds and flowers from detailed text descriptions.

Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, Honglak Lee• 2016

Related benchmarks

TaskDatasetResultRank
Image GenerationCIFAR-10 (test)
FID19.2
471
Image GenerationImageNet (val)--
198
Text-to-Image SynthesisMS-COCO (val)--
35
Text-to-Image GenerationCOCO (test)--
18
Class-conditional Image GenerationCIFAR-100 (test)
FID24.8
17
Text-to-Image SynthesisCUB (test)--
16
Text-to-Image SynthesisMS-COCO 2014 (test)
IS7.88
11
Text-to-Image SynthesisOxford-102 (test)--
8
Super-ResolutionImageNet ILSVRC2012 (val)
Inception Acc11
5
Text-to-Image SynthesisCUB
Inception Score2.88
5
Showing 10 of 14 rows

Other info

Follow for update