Accelerating NeurASP with vectorization and caching
About
Neurosymbolic AI combines neural networks with symbolic programs to create robust and explainable predictions. One such framework is NeurASP, which trains a neural network to predict concepts and reasons over them using rules written in answer set programming (ASP) to solve downstream tasks. Crucially, labels are only provided for the downstream prediction produced by the symbolic rules, not for the latent concepts themselves. Backpropagation through the non-differentiable ASP component requires expensive probability and gradient calculations, which has hindered scalability to more sophisticated tasks. In this paper, we address the current limitations of NeurASP by improving its computational performance through vectorization, batch processing and caching of intermediate computations during training. We compare computation speeds between the original and our new implementation of NeurASP and report speedups of multiple orders of magnitude for larger tasks. To this end, we propose a new dataset of difficult tasks involving playing cards, which we use to test the capabilities of NeurASP's enhanced learning function.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Card summation | Card sum 3 (test) | Downstream Accuracy90 | 2 | |
| Membership Detection | Member 3 (test) | Downstream Accuracy98 | 2 | |
| Membership Detection | Member 5 (test) | Downstream Accuracy98 | 2 | |
| MNIST Addition | MNIST addition (test) | Downstream Accuracy97 | 2 | |
| Card product-summation | Card prodsum 2 (test) | Downstream Accuracy98 | 1 | |
| Card product-summation | Card prodsum 4 (test) | Downstream Accuracy74 | 1 | |
| Card summation | Card sum 2 (test) | Downstream Accuracy97 | 1 | |
| Card summation | Card sum 4 (test) | Downstream Accuracy60 | 1 |