Generative Flows with Matrix Exponential
About
Generative flows models enjoy the properties of tractable exact likelihood and efficient sampling, which are composed of a sequence of invertible functions. In this paper, we incorporate matrix exponential into generative flows. Matrix exponential is a map from matrices to invertible matrices, this property is suitable for generative flows. Based on matrix exponential, we propose matrix exponential coupling layers that are a general case of affine coupling layers and matrix exponential invertible 1 x 1 convolutions that do not collapse during training. And we modify the networks architecture to make trainingstable andsignificantly speed up the training process. Our experiments show that our model achieves great performance on density estimation amongst generative flows models.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Unconditional Image Generation | CIFAR10 | BPD3.32 | 33 | |
| Unconditional Image Generation | ImageNet-32 | BPD4.05 | 31 | |
| Unconditional Image Generation | ImageNet 64 | BPD3.73 | 22 | |
| Image Generation | Glow Latent Space original (test) | Inference Time (s)0.3839 | 4 | |
| Generative Modeling | CIFAR-10 | Training Time (s)2.46e+3 | 2 | |
| Generative Modeling | ImageNet 32x32 | Avg Training Time (s)3.23e+4 | 2 | |
| Generative Modeling | ImageNet 64x64 | Avg Training Time (s)4.25e+4 | 2 |