Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Node Identifiers: Compact, Discrete Representations for Efficient Graph Learning

About

We present a novel end-to-end framework that generates highly compact (typically 6-15 dimensions), discrete (int4 type), and interpretable node representations, termed node identifiers (node IDs), to tackle inference challenges on large-scale graphs. By employing vector quantization, we compress continuous node embeddings from multiple layers of a Graph Neural Network (GNN) into discrete codes, applicable under both self-supervised and supervised learning paradigms. These node IDs capture high-level abstractions of graph data and offer interpretability that traditional GNN embeddings lack. Extensive experiments on 34 datasets, encompassing node classification, graph classification, link prediction, and attributed graph clustering tasks, demonstrate that the generated node IDs significantly enhance speed and memory efficiency while achieving competitive performance compared to current state-of-the-art methods.

Yuankai Luo, Hongkang Li, Qijiong Liu, Lei Shi, Xiao-Ming Wu• 2024

Related benchmarks

TaskDatasetResultRank
Graph ClassificationPROTEINS
Accuracy75.9
1252
Graph ClassificationMUTAG
Accuracy90.4
1103
Node ClassificationChameleon
Accuracy46.29
867
Node ClassificationSquirrel
Accuracy45.09
786
Graph ClassificationNCI1
Accuracy78.2
658
Node ClassificationPubmed
Accuracy89.42
627
Node ClassificationCiteseer
Accuracy76.89
503
Graph ClassificationCOLLAB
Accuracy76.9
469
Graph ClassificationIMDB-B
Accuracy72.4
425
Node ClassificationPhoto
Mean Accuracy96.47
374
Showing 10 of 47 rows

Other info

Code

Follow for update