VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming
About
We present VAEL, a neuro-symbolic generative model integrating variational autoencoders (VAE) with the reasoning capabilities of probabilistic logic (L) programming. Besides standard latent subsymbolic variables, our model exploits a probabilistic logic program to define a further structured representation, which is used for logical reasoning. The entire process is end-to-end differentiable. Once trained, VAEL can solve new unseen generation tasks by (i) leveraging the previously acquired knowledge encoded in the neural component and (ii) exploiting new logical programs on the structured latent space. Our experiments provide support on the benefits of this neuro-symbolic integration both in terms of task generalization and data efficiency. To the best of our knowledge, this work is the first to propose a general-purpose end-to-end framework integrating probabilistic logic programming into a deep generative model.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Classification | MM-A out-of-distribution (OOD) | Task Accuracy35.76 | 6 | |
| Image Classification | MM-A in-distribution (test) | Accuracy90.7 | 6 | |
| Classification | PokerRules standard (test) | Task Accuracy80.23 | 6 | |
| Classification | PokerRules standard (OOD class) | Accuracy0.46 | 2 | |
| Object-level Decomposition | MM-A in-distribution (test) | Concept Accuracy55.43 | 2 | |
| Object-level Decomposition | MM-A (out-of-distribution) | Concept Accuracy23.83 | 2 | |
| PokerRules | PokerRules In-distribution (test) | Task Accuracy80.23 | 2 | |
| PokerRules | PokerRules (OOD class) | Task Accuracy (OOD)0.46 | 2 |