Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneity

About

Recently, Federated Graph Learning (FGL) has attracted significant attention as a distributed framework based on graph neural networks, primarily due to its capability to break data silos. Existing FGL studies employ community split on the homophilous global graph by default to simulate federated semi-supervised node classification settings. Such a strategy assumes the consistency of topology between the multi-client subgraphs and the global graph, where connected nodes are highly likely to possess similar feature distributions and the same label. However, in real-world implementations, the varying perspectives of local data engineering result in various subgraph topologies, posing unique heterogeneity challenges in FGL. Unlike the well-known label Non-independent identical distribution (Non-iid) problems in federated learning, FGL heterogeneity essentially reveals the topological divergence among multiple clients, namely homophily or heterophily. To simulate and handle this unique challenge, we introduce the concept of structure Non-iid split and then present a new paradigm called \underline{Ada}ptive \underline{F}ederated \underline{G}raph \underline{L}earning (AdaFGL), a decoupled two-step personalized approach. To begin with, AdaFGL employs standard multi-client federated collaborative training to acquire the federated knowledge extractor by aggregating uploaded models in the final round at the server. Then, each client conducts personalized training based on the local subgraph and the federated knowledge extractor. Extensive experiments on the 12 graph benchmark datasets validate the superior performance of AdaFGL over state-of-the-art baselines. Specifically, in terms of test accuracy, our proposed AdaFGL outperforms baselines by significant margins of 3.24\% and 5.57\% on community split and structure Non-iid split, respectively.

Xunkai Li, Zhengyu Wu, Wentao Zhang, Henan Sun, Rong-Hua Li, Guoren Wang• 2024

Related benchmarks

TaskDatasetResultRank
Federated LearningCora
Time Consumption (s)1.99
84
Federated LearningRoman-Empire
Time Consumption (s)4.14
84
Node ClassificationRoman-empire non-overlapping subgraph partitioning
Accuracy67.64
45
Node ClassificationMinesweeper non-overlapping subgraph partitioning
AUC73.24
45
Node ClassificationQuestions non-overlapping subgraph partitioning
AUC64.23
45
Node ClassificationAmazon-ratings non-overlapping subgraph partitioning
Accuracy42.59
45
Node ClassificationTolokers (non-overlapping subgraph partitioning)
AUC (%)59.26
45
Node ClassificationCiteseer
Accuracy68.45
45
Node ClassificationOgbn-arxiv
Overall F138.52
40
Node ClassificationRoman-empire overlapping subgraph partitioning
Accuracy64.44
39
Showing 10 of 45 rows

Other info

Follow for update