PyG 2.0: Scalable Learning on Real World Graphs
About
PyG (PyTorch Geometric) has evolved significantly since its initial release, establishing itself as a leading framework for Graph Neural Networks. In this paper, we present Pyg 2.0 (and its subsequent minor versions), a comprehensive update that introduces substantial improvements in scalability and real-world application capabilities. We detail the framework's enhanced architecture, including support for heterogeneous and temporal graphs, scalable feature/graph stores, and various optimizations, enabling researchers and practitioners to tackle large-scale graph learning problems efficiently. Over the recent years, PyG has been supporting graph learning in a large variety of application areas, which we will summarize, while providing a deep dive into the important areas of relational deep learning and large language modeling.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Graph Transformer Efficiency Benchmarking | Ogbn-arxiv | Latency Speedup (Forward)0.95 | 9 | |
| Graph Transformer Efficiency Benchmarking | city-roads L | Latency Speedup (Forward)1.54 | 7 | |
| Graph Transformer Efficiency Benchmarking | tolokers 2 | Latency Speedup (Forward Pass)0.45 | 6 | |
| SpMM with GCN operator | Ogbn-arxiv | Forward Latency Speedup0.2 | 6 | |
| SpMM with GCN operator | twitch-views | Latency Speedup (fwd)0.06 | 6 | |
| SpMM with GCN operator | tolokers 2 | Latency Speedup (Forward)0.11 | 6 | |
| SpMM with GCN operator | city-roads L | Latency Speedup (Forward)0.36 | 6 | |
| Graph Transformer Efficiency Benchmarking | city-roads M | Latency Speedup (Forward)0.42 | 5 | |
| Efficiency evaluation of GATv2 | artnet-exp | Latency speedup (fwd)0.39 | 4 | |
| Efficiency evaluation of GATv2 | twitch-views | Latency Speedup (Forward)0.57 | 2 |