Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Generative Flows with Matrix Exponential

About

Generative flows models enjoy the properties of tractable exact likelihood and efficient sampling, which are composed of a sequence of invertible functions. In this paper, we incorporate matrix exponential into generative flows. Matrix exponential is a map from matrices to invertible matrices, this property is suitable for generative flows. Based on matrix exponential, we propose matrix exponential coupling layers that are a general case of affine coupling layers and matrix exponential invertible 1 x 1 convolutions that do not collapse during training. And we modify the networks architecture to make trainingstable andsignificantly speed up the training process. Our experiments show that our model achieves great performance on density estimation amongst generative flows models.

Changyi Xiao, Ligang Liu• 2020

Related benchmarks

TaskDatasetResultRank
Unconditional Image GenerationCIFAR10
BPD3.32
33
Unconditional Image GenerationImageNet-32
BPD4.05
31
Unconditional Image GenerationImageNet 64
BPD3.73
22
Image GenerationGlow Latent Space original (test)
Inference Time (s)0.3839
4
Generative ModelingCIFAR-10
Training Time (s)2.46e+3
2
Generative ModelingImageNet 32x32
Avg Training Time (s)3.23e+4
2
Generative ModelingImageNet 64x64
Avg Training Time (s)4.25e+4
2
Showing 7 of 7 rows

Other info

Follow for update