FedGTA: Topology-aware Averaging for Federated Graph Learning

Xunkai Li, Zhengyu Wu, Wentao Zhang, Yinlin Zhu, Ronghua Li, Guoren Wang

Main figure for FedGTA: Topology-aware Averaging for Federated Graph Learning

Abstract

Federated Graph Learning (FGL) is a distributed machine learning paradigm that enables collaborative training on large-scale subgraphs across multiple local systems. Existing FGL studies fall into two categories: (i) FGL Optimization, which improves multi-client training in existing machine learning models; (ii) FGL Model, which enhances performance with complex local models and multi-client interactions. However, most FGL optimization strategies are designed specifically for the computer vision domain and ignore graph structure, presenting dissatisfied performance and slow convergence. Meanwhile, complex local model architectures in FGL Models studies lack scalability for handling large-scale subgraphs and have deployment limitations. To address these issues, we propose Federated Graph Topology-aware Aggregation (FedGTA), a personalized optimization strategy that optimizes through topology-aware local smoothing confidence and mixed neighbor features. During experiments, we deploy FedGTA in 12 multi-scale real-world datasets with the Louvain and Metis split. This allows us to evaluate the performance and robustness of FedGTA across a range of scenarios. Extensive experiments demonstrate that FedGTA achieves state-of-the-art performance while exhibiting high scalability and efficiency. The experiment includes ogbn-papers100M, the most representative large-scale graph database so that we can verify the applicability of our method to large-scale graph learning. To the best of our knowledge, our study is the first to bridge large-scale graph learning with FGL using this optimization strategy, contributing to the development of efficient and scalable FGL methods.

Proposed method: FedGTA

Benchmark Results

Tested on 6 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
0.9669 ±0.0014
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
209
GAMLP (Global)
0.9310 ±0.0050
This paper
241
GCN (Global)
0.9280 ±0.0030
This paper
390
MLP
0.9128 ±0.0063
#ModelF1 ↑Paper
1
EnGCN
0.9714 ±0.0003
2
SAGN+SLE
0.9710
3
GAMLP(JK)
0.9704 ±0.0001
14
GraphSAGE
0.9660
66
FedGTA
0.9507 ±0.0008
This paper
102
S^2GC (FedDC)
0.9330 ±0.0012
This paper
115
SIGN (FedDC)
0.9146 ±0.0005
This paper
#ModelAccuracy ↑Paper
1
GrokFormer
0.9831 ±0.0018
2
PolyFormer
0.9808 ±0.0027
3
SGFormer
0.9796 ±0.0081
9
GCN
0.9774 ±0.0035
58
MLP
0.9597 ±0.0007
207
GAMLP (Global)
0.9360 ±0.0100
This paper
233
GCN (Global)
0.9310 ±0.0060
This paper

OGB

#ModelAccuracy ↑Paper
1
Jacobi
0.8968
2
GPR
0.8953
3
LEMP4HG
0.8939
4
SAGE
0.8933
57
GAMLP (Global)
0.8420 ±0.0030
This paper
240
GCN (Global)
0.7630 ±0.0020
This paper
351
MLP
0.6605 ±0.0020
#ModelAccuracy ↑Paper
1
SGC
0.7910
2
GAMLP
0.7036 ±0.0002
3
GLEM-GNN
0.7036 ±0.0002
33
GAMLP (FedGTA)
0.6650 ±0.0030
This paper
35
SAGE
0.6644 ±0.0017
87
GCN (FedGTA)
0.6060 ±0.0030
This paper
95
MLP
0.4960 ±0.0030
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers)