Adversarial Autoencoders
About
In this paper, we propose the "adversarial autoencoder" (AAE), which is a probabilistic autoencoder that uses the recently proposed generative adversarial networks (GAN) to perform variational inference by matching the aggregated posterior of the hidden code vector of the autoencoder with an arbitrary prior distribution. Matching the aggregated posterior to the prior ensures that generating from any part of prior space results in meaningful samples. As a result, the decoder of the adversarial autoencoder learns a deep generative model that maps the imposed prior to the data distribution. We show how the adversarial autoencoder can be used in applications such as semi-supervised classification, disentangling style and content of images, unsupervised clustering, dimensionality reduction and data visualization. We performed experiments on MNIST, Street View House Numbers and Toronto Face datasets and show that adversarial autoencoders achieve competitive results in generative modeling and semi-supervised classification tasks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Autoencoding | Mathematical expressions EVAL (test) | BLEU41 | 22 | |
| Sentence Interpolation Smoothness | ARGO randomly sampled 200 sentence pairs | Average IS0.142 | 22 | |
| Language modelling | Explanatory sentences | BLEU35 | 19 | |
| Language modelling | Mathematical expression EVAL (test) | Exact Match10 | 19 | |
| Classification | MNIST | Error Rate0.85 | 18 | |
| Semi-supervised classification | MNIST 100 labels | Error Rate0.019 | 16 | |
| Semi-supervised classification | SVHN 1000 labels | Error Rate17.7 | 14 | |
| Autoencoding | Explanatory sentences (test) | BLEU35 | 13 | |
| Autoencoding | Mathematical expressions LEN (test) | BLEU0.52 | 11 | |
| Autoencoding | Mathematical expressions EASY (test) | BLEU Score39 | 11 |