Fast Graph Generation via Autoregressive Noisy Filtration Modeling
About
Existing graph generative models often face a critical trade-off between sample quality and generation speed. We introduce Autoregressive Noisy Filtration Modeling (ANFM), a flexible autoregressive framework that addresses both challenges. ANFM leverages filtration, a concept from topological data analysis, to transform graphs into short sequences of subgraphs. We identify exposure bias as a potential hurdle in autoregressive graph generation and propose noise augmentation and reinforcement learning as effective mitigation strategies, which allow ANFM to learn both edge addition and deletion operations. This unique capability enables ANFM to correct errors during generation by modeling non-monotonic graph sequences. Our results show that ANFM matches state-of-the-art diffusion models in quality while offering over 100 times faster inference, making it a promising approach for high-throughput graph generation. The source code is publicly available at https://github.com/BorgwardtLab/anfm .
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Molecule Graph Generation | GuacaMol (test) | Validity75.6 | 17 | |
| Graph generation | SPECTRE SBM Graphs (test) | Degree Metric7.00e-4 | 9 | |
| Graph generation | SPECTRE Planar Graphs (test) | VUN (%)7.25e+3 | 8 | |
| Graph generation | Expanded SBM Graphs N_train = 8192 (test) | VUN78.03 | 5 | |
| Graph generation | Expanded Lobster (test) | Uniqueness99.8 | 5 | |
| Graph generation | Expanded Lobster Graphs N_train = 8192 (test) | VUN87.6 | 5 | |
| Graph generation | Protein Graphs 100 <= |V| <= 500 Ntrain = 587 | Degree Fidelity0.0024 | 5 | |
| Graph generation | Expanded Planar Graphs |V| = 64, N_train = 8192 (test) | VUN79.2 | 5 | |
| Graph generation | Expanded Planar (test) | Uniqueness100 | 5 | |
| Graph generation | Expanded SBM (test) | Uniqueness100 | 5 |