LPS-GNN: Deploying Graph Neural Networks on Graphs with 100-Billion Edges

Xu Cheng, Liang Yao, F. He, Yukuo Cen, Yufei He, Chenhui Zhang, Wenzheng Feng, H. Cai, Jie Tang

Main figure for LPS-GNN: Deploying Graph Neural Networks on Graphs with 100-Billion Edges

Abstract

Graph Neural Networks (GNNs) have emerged as powerful tools for various graph mining tasks, yet existing scalable solutions often struggle to balance execution efficiency with prediction accuracy. These difficulties stem from iterative message-passing techniques, which place significant computational demands and require extensive GPU memory, particularly when dealing with the neighbor explosion issue inherent in large-scale graphs. This paper introduces a scalable, low-cost, flexible, and efficient GNN framework called LPS-GNN, which can perform representation learning on 100 billion graphs with a single GPU in 10 hours and shows a 13.8\ We examine existing graph partitioning methods and design a superior graph partition algorithm named LPMetis. In particular, LPMetis outperforms current state-of-the-art (SOTA) approaches on various evaluation metrics.In addition, our paper proposes a subgraph augmentation strategy to enhance the model's predictive performance. It exhibits excellent compatibility, allowing the entire framework to accommodate various GNN algorithms. Successfully deployed on the Tencent platform, LPS-GNN has been tested on public and real-world datasets, achieving performance lifts of 8. 24\

Benchmark Results

Tested on 1 dataset 1 baseline value reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

OGB

#ModelAccuracy ↑Paper
1
Jacobi
0.8968
2
GPR
0.8953
3
LEMP4HG
0.8939
4
SAGE
0.8933
83
GraphSAGE
actual #83 vs paper #349 266 places worse
0.8287
best reported
actual #83 vs paper #349 266 places worse
paper 0.6633
159
Cluster-GAT (LPMetis)
0.7961
This paper
175
Cluster-SAGE (LPMetis)
0.7926
This paper
231
MariusGNN
0.7695
This paper
264
Cluster-GCN (LPMetis)
0.7527
This paper
273
LLM-GNN
0.7491
This paper
351
MLP
0.6605 ±0.0020
389
LR
0.4069
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green)