Less Can Be More: Unsupervised Graph Pruning for Large-scale Dynamic Graphs

Jintang Li, Sheng Tian, Ruofan Wu, Liang Zhu, Wenlong Zhao, Changhua Meng, Liang Chen, Zibin Zheng, Hongzhi Yin

Main figure for Less Can Be More: Unsupervised Graph Pruning for Large-scale Dynamic Graphs

Abstract

The prevalence of large-scale graphs poses great challenges in time and storage for training and deploying graph neural networks (GNNs). Several recent works have explored solutions for pruning the large original graph into a small and highly-informative one, such that training and inference on the pruned and large graphs have comparable performance. Although empirically effective, current researches focus on static or non-temporal graphs, which are not directly applicable to dynamic scenarios. In addition, they require labels as ground truth to learn the informative structure, limiting their applicability to new problem domains where labels are hard to obtain. To solve the dilemma, we propose and study the problem of unsupervised graph pruning on dynamic graphs. We approach the problem by our proposed STEP, a self-supervised temporal pruning framework that learns to remove potentially redundant edges from input dynamic graphs. From a technical and industrial viewpoint, our method overcomes the trade-offs between the performance and the time & memory overheads. Our results on three real-world datasets demonstrate the advantages on improving the efficacy, robustness, and efficiency of GNNs on dynamic node classification tasks. Most notably, STEP is able to prune more than 50\

Benchmark Results

Tested on 1 dataset Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

Reddit

Global leaderboard →
Non-default metric. This paper reports AUC; the dataset default is F1. Values below use AUC only.

Sorted by AUC. Highlighted rows are from other papers.

#ModelAUC ↑Paper
1
SPLASH
0.7358 ±0.0028
2
Backbone (TGAT)
0.6822 ±0.0052
This paper
3
PINT
0.6731 ±0.0020
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers)