Bring Your Own View: Graph Neural Networks for Link Prediction with Personalized Subgraph Selection

Qiaoyu Tan, Xin Zhang, Ninghao Liu, D. Zha, Li Li, Rui Chen, Soo-Hyun Choi, Xia Hu

Main figure for Bring Your Own View: Graph Neural Networks for Link Prediction with Personalized Subgraph Selection

Abstract

Graph neural networks (GNNs) have received remarkable success in link prediction (GNNLP) tasks. Existing efforts first predefine the subgraph for the whole dataset and then apply GNNs to encode edge representations by leveraging the neighborhood structure induced by the fixed subgraph. The prominence of GNNLP methods significantly relies on the adhoc subgraph. Since node connectivity in real-world graphs is complex, one shared subgraph is limited for all edges. Thus, the choices of subgraphs should be personalized to different edges. However, performing personalized subgraph selection is nontrivial since the potential selection space grows exponentially to the scale of edges. Besides, the inference edges are not available during training in link prediction scenarios, so the selection process needs to be inductive. To bridge the gap, we introduce a Personalized Subgraph Selector (PS2) as a plug-and-play framework to automatically, personally, and inductively identify optimal subgraphs for different edges when performing GNNLP. PS2 is instantiated as a bi-level optimization problem that can be efficiently solved differently. Coupling GNNLP models with PS2, we suggest a brand-new angle towards GNNLP training: by first identifying the optimal subgraphs for edges; and then focusing on training the inference model by using the sampled subgraphs. Comprehensive experiments endorse the effectiveness of our proposed method across various GNNLP backbones (GCN, GraphSage, NGCF, LightGCN, and SEAL) and diverse benchmarks (Planetoid, OGB, and Recommendation datasets). Our code is publicly available at

Benchmark Results

Tested on 3 datasets 1 baseline value reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

OGB

#ModelHits@50 ↑Paper
1
PROXI
0.7650 ±0.0027
2
OGB Leader
0.7129 ±0.0018
3
GIDN
0.7096 ±0.0055
9
GCN
0.6621 ±0.0033
18
SEAL-PS2
0.6483 ±0.0054
This paper
20
SEAL
actual #20 vs paper #26 6 places worse
0.6474 ±0.0043
best reported
actual #20 vs paper #26 6 places worse
paper 0.6364 ±0.0071
35
GraphSage-PS2
0.5571 ±0.0093
This paper
41
GraphSAGE
0.5463 ±0.0112
This paper
61
GAE-PS2
0.5026 ±0.0032
This paper
92
GAE
0.4475 ±0.0107
This paper
94
MLP
0.4438 ±0.0347
97
SEAL-RS
0.4356 ±0.0130
This paper
104
GraphSage-RS
0.3754 ±0.0037
This paper
107
GAE-RS
0.3451 ±0.0068
This paper
#ModelHits@20 ↑Paper
1
ELGNN
0.9777 ±0.0037
2
GIDN
0.9542
3
AGDN
0.9538 ±0.0094
20
SAGE
0.6719 ±0.0118
33
GraphSage-PS2
0.5690 ±0.0532
This paper
38
GraphSAGE
0.5390 ±0.0474
This paper
43
SEAL
actual #43 vs paper #59 16 places worse
0.4974 ±0.0239
best reported
actual #43 vs paper #59 16 places worse
paper 0.3056 ±0.0386
44
GAE-PS2
0.4953 ±0.0599
This paper
54
GAE
0.3707 ±0.0507
This paper
58
SEAL-PS2
0.3277 ±0.0250
This paper
59
GAE-RS
0.3072 ±0.0686
This paper
63
GraphSage-RS
0.2717 ±0.0574
This paper
67
SEAL-RS
0.2458 ±0.0465
This paper
#ModelHits@100 ↑Paper
1
OGB Leader
0.6524 ±0.0150
2
PRB
0.6347 ±0.0175
3
LPFormer
0.6332 ±0.0063
12
SEAL-PS2
0.5025 ±0.0233
This paper
14
SAGE
0.5013 ±0.0055
19
SEAL
0.4880 ±0.0316
This paper
23
MLP
0.4600
37
SEAL-RS
0.3568 ±0.0521
This paper
58
GAE-PS2
0.2050 ±0.0079
This paper
61
GAE
0.1867 ±0.0132
This paper
62
GraphSage-PS2
0.1788 ±0.0133
This paper
63
GraphSAGE
0.1655 ±0.0240
This paper
65
GAE-RS
0.1265 ±0.0122
This paper
68
GraphSage-RS
0.0989 ±0.0346
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere