Global-Local Graph Neural Networks for Node-Classification

Moshe Eliasof, Eran Treister

Main figure for Global-Local Graph Neural Networks for Node-Classification

Abstract

The task of graph node classification is often approached blackby utilizing a local Graph Neural Network (GNN), that learns only local information from the node input features and their adjacency. In this paper, we propose to black improve the performance of node classification GNNs by utilizing both global and local information, specifically by learning label- and node- features. We therefore call our method Global-Local-GNN (GLGNN). To learn proper label features, for each label, we maximize the similarity between its features and nodes features that belong to the label, while maximizing the distance between nodes that do not belong to the considered label. We then use the learnt label features to predict the node classification map. We demonstrate our GLGNN using three different GNN backbones, and show that our approach improves baseline performance, revealing the importance of global information utilization blackfor node classification.

Proposed method: CNNs

Benchmark Results

Tested on 5 datasets 28 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
actual #39 vs paper #272 233 places worse
0.9330 ±0.0290
best reported
actual #39 vs paper #272 233 places worse
paper 0.8900 ±0.0600

Difference within reported uncertainty; not counted as underperformance.

paper 0.8900 ±0.0600 Δ at pub 0.0430
63
GCN
actual #63 vs paper #432 369 places worse
0.9220 ±0.0440
best reported
actual #63 vs paper #432 369 places worse
paper 0.8560 ±0.0580

Difference within reported uncertainty; not counted as underperformance.

paper 0.8560 ±0.0580 Δ at pub 0.0350 Δ today 0.0660
131
GLGIN
0.9080 ±0.0610
This paper
158
GraphSAGE
0.9040 ±0.0780
319
GLGCN
0.8830 ±0.0510
This paper
403
MLP
0.8660 ±0.0495

Heterophilic Graphs

#ModelAccuracy ↑Paper
1
P^2GNN
0.9672 ±0.0147
2
DoG
0.9660 ±0.0210
3
GPF-plus
0.9583 ±0.0419
28
GPRGNN
actual #28 vs paper #185 157 places worse
0.9295 ±0.0131
best reported
actual #28 vs paper #185 157 places worse
paper 0.8294
paper 0.8294 Δ at pub 0.0998 Δ today 0.1001
34
MLP
0.9230 ±0.0070
39
GGCN
actual #39 vs paper #104 65 places worse
0.8686
actual #39 vs paper #104 65 places worse
paper 0.8686
best today: Graph Wave Networks (WWW 2025)

Improvement within reported uncertainty; not highlighted.

paper 0.8686 Δ at pub 0.0200 Δ today 0.0527
40
H2GCN
actual #40 vs paper #94 54 places worse
0.8765
actual #40 vs paper #94 54 places worse
paper 0.8765
46
APPNP
actual #46 vs paper #438 392 places worse
0.9131 ±0.0197
best reported
actual #46 vs paper #438 392 places worse
paper 0.6541
paper 0.6541 Δ at pub 0.2590
53
GraphSAGE
0.9000 ±0.0365
61
FAGCN
actual #61 vs paper #185 124 places worse
0.8961 ±0.0152
best reported
actual #61 vs paper #185 124 places worse
paper 0.8294
paper 0.8294 Δ at pub 0.0667
70
GCNII*
actual #70 vs paper #215 145 places worse
0.8157
actual #70 vs paper #215 145 places worse
paper 0.8157

Improvement within reported uncertainty; not highlighted.

paper 0.8157 Δ at pub 0.0111 Δ today 0.0761
81
GLGCNII
0.8862
This paper
104
WRGAT
actual #104 vs paper #104
0.8698
actual #104 vs paper #104
paper 0.8698

Improvement within reported uncertainty; not highlighted.

paper 0.8698 Δ at pub 0.0336
211
GAT
actual #211 vs paper #584 373 places worse
0.8162 ±0.0645
best reported
actual #211 vs paper #584 373 places worse
paper 0.4941
paper 0.4941 Δ at pub 0.3059 Δ today 0.3221
217
GRAND
actual #217 vs paper #255 38 places worse
0.8140 ±0.0350
best reported
actual #217 vs paper #255 38 places worse
paper 0.7941

Difference within reported uncertainty; not counted as underperformance.

paper 0.7941 Δ at pub 0.0079 Δ today 0.0199
257
GCN
actual #257 vs paper #586 329 places worse
0.7933 ±0.0447
best reported
actual #257 vs paper #586 329 places worse
paper 0.4892
best today: Graph Wave Networks (WWW 2025)
paper 0.4892 Δ at pub 0.2948 Δ today 0.3041
259
PowerEmbed
0.7919
This paper
415
Geom-GCN
actual #415 vs paper #449 34 places worse
0.6760
best reported
actual #415 vs paper #449 34 places worse
paper 0.6412
paper 0.6412 Δ at pub 0.0348
433
GLGAT
0.6588
This paper
440
GLGCN
0.6529
This paper
499
PairNorm
actual #499 vs paper #591 92 places worse
0.6030 ±0.0430
best reported
actual #499 vs paper #591 92 places worse
paper 0.4843
best at pub: Graph-Coupled Oscillator Networks (ICML 2022)
paper 0.4843 Δ at pub 0.1187 Δ today 0.1187
#ModelAccuracy ↑Paper
1
P^2GNN
0.9541 ±0.0272
2
ACM-GCN
0.9480 ±0.0380
3
RF-GCN
0.9429
15
GGCN
actual #15 vs paper #79 64 places worse
0.9230 ±0.0367
best reported
actual #15 vs paper #79 64 places worse
paper 0.8568
paper 0.8568 Δ today 0.0662
21
APPNP
actual #21 vs paper #435 414 places worse
0.9181 ±0.0196
best reported
actual #21 vs paper #435 414 places worse
paper 0.5430
paper 0.5430 Δ at pub 0.3751
22
GPRGNN
actual #22 vs paper #177 155 places worse
0.9157 ±0.0196
best reported
actual #22 vs paper #177 155 places worse
paper 0.8027
paper 0.8027 Δ at pub 0.1130
24
MLP
0.9136 ±0.0070
32
GLGCNII
0.8919
This paper
35
GCNII*
actual #35 vs paper #218 183 places worse
0.8918 ±0.0396
best reported
actual #35 vs paper #218 183 places worse
paper 0.7649
paper 0.7649 Δ at pub 0.0777 Δ today 0.1269
38
FAGCN
actual #38 vs paper #185 147 places worse
0.8852 ±0.0133
best reported
actual #38 vs paper #185 147 places worse
paper 0.7919
paper 0.7919 Δ at pub 0.0933
68
H2GCN
actual #68 vs paper #136 68 places worse
0.8623 ±0.0471
best reported
actual #68 vs paper #136 68 places worse
paper 0.8270

Difference within reported uncertainty; not counted as underperformance.

paper 0.8270 Δ at pub 0.0240 Δ today 0.0353
138
SAGE
0.8269
142
GRAND
actual #142 vs paper #151 9 places worse
0.8246 ±0.0709
best reported
actual #142 vs paper #151 9 places worse
paper 0.8216

Difference within reported uncertainty; not counted as underperformance.

paper 0.8216 Δ at pub 0.0004 Δ today 0.0030
158
GAT
actual #158 vs paper #434 276 places worse
0.8190 ±0.0540
best reported
actual #158 vs paper #434 276 places worse
paper 0.5432
paper 0.5432 Δ at pub 0.2758
160
WRGAT
0.8162
This paper
170
GCN
actual #170 vs paper #459 289 places worse
0.8082 ±0.0360
best reported
actual #170 vs paper #459 289 places worse
paper 0.5270
paper 0.5270 Δ at pub 0.2745 Δ today 0.2812
195
PowerEmbed
0.7830
This paper
224
GLGAT
0.7567
This paper
234
GLGCN
0.7486
This paper
342
Geom-GCN
actual #342 vs paper #369 27 places worse
0.6412
best reported
actual #342 vs paper #369 27 places worse
paper 0.6081
paper 0.6081 Δ at pub 0.0331
389
PairNorm
0.5892
This paper
#ModelAccuracy ↑Paper
1
DiGGR
0.4535 ±0.0353
2
TRIGON
0.4402 ±0.0028
3
DoG
0.4320 ±0.0120
38
GCNII*
actual #38 vs paper #278 240 places worse
0.4082 ±0.0179
best reported
actual #38 vs paper #278 240 places worse
paper 0.3361
paper 0.3361 Δ at pub 0.0500 Δ today 0.0721
41
APPNP
actual #41 vs paper #70 29 places worse
0.4046 ±0.0064
best reported
actual #41 vs paper #70 29 places worse
paper 0.3886
paper 0.3886 Δ at pub 0.0160
42
MLP
0.4026 ±0.0108
52
GPRGNN
actual #52 vs paper #247 195 places worse
0.3992 ±0.0067
best reported
actual #52 vs paper #247 195 places worse
paper 0.3463
paper 0.3463 Δ at pub 0.0529 Δ today 0.0529
56
FAGCN
actual #56 vs paper #240 184 places worse
0.3970
best reported
actual #56 vs paper #240 184 places worse
paper 0.3487
paper 0.3487 Δ at pub 0.0483
62
GGCN
actual #62 vs paper #99 37 places worse
0.3929 ±0.0048
best reported
actual #62 vs paper #99 37 places worse
paper 0.3781
paper 0.3781 Δ today 0.0148
68
GraphSAGE
0.3899 ±0.0085
71
H2GCN
actual #71 vs paper #198 127 places worse
0.3885 ±0.0117
best reported
actual #71 vs paper #198 127 places worse
paper 0.3570
75
WRGAT
actual #75 vs paper #158 83 places worse
0.3860 ±0.0110
best reported
actual #75 vs paper #158 83 places worse
paper 0.3653
87
Geom-GCN
actual #87 vs paper #305 218 places worse
0.3810
best reported
actual #87 vs paper #305 218 places worse
paper 0.3163
paper 0.3163 Δ at pub 0.0647
135
GCN
actual #135 vs paper #408 273 places worse
0.3690
best reported
actual #135 vs paper #408 273 places worse
paper 0.2732
paper 0.2732 Δ at pub 0.0958
182
GAT
actual #182 vs paper #406 224 places worse
0.3605 ±0.0035
best reported
actual #182 vs paper #406 224 places worse
paper 0.2744
paper 0.2744 Δ at pub 0.0861
203
GRAND
0.3562
This paper
263
GLGCNII
0.3413
This paper
296
GLGCN
0.3245
This paper
305
GLGAT
0.3184
This paper
408
PairNorm
0.2740
This paper
#ModelAccuracy ↑Paper
1
DMD++
0.9190 ±0.0260
2
F-GREAD-BS
0.9059 ±0.0380
3
APPNP
actual #3 vs paper #114 111 places worse
0.9010 ±0.0350
best reported
actual #3 vs paper #114 111 places worse
paper 0.7351
paper 0.7351 Δ at pub 0.1079 Δ today 0.1659
5
GPRGNN
actual #5 vs paper #89 84 places worse
0.8990 ±0.0300
best reported
actual #5 vs paper #89 84 places worse
paper 0.7838
paper 0.7838 Δ at pub 0.0712 Δ today 0.1152
6
GLGCNII
0.8972
This paper
13
GRAND
actual #13 vs paper #96 83 places worse
0.8860 ±0.0210
best reported
actual #13 vs paper #96 83 places worse
paper 0.7568
paper 0.7568 Δ at pub 0.0373 Δ today 0.1292
22
H2GCN
actual #22 vs paper #45 23 places worse
0.8790 ±0.0420
best reported
actual #22 vs paper #45 23 places worse
paper 0.8486

Difference within reported uncertainty; not counted as underperformance.

paper 0.8486 Δ at pub 0.0279 Δ today 0.0304
29
WRGAT
actual #29 vs paper #58 29 places worse
0.8698 ±0.0378
best reported
actual #29 vs paper #58 29 places worse
paper 0.8362

Difference within reported uncertainty; not counted as underperformance.

paper 0.8362 Δ at pub 0.0336 Δ today 0.0336
32
GGCN
actual #32 vs paper #45 13 places worse
0.8686 ±0.0320
best reported
actual #32 vs paper #45 13 places worse
paper 0.8486

Difference within reported uncertainty; not counted as underperformance.

paper 0.8486 Δ at pub 0.0200 Δ today 0.0200
37
MLP
0.8629 ±0.0450
53
GAT
actual #53 vs paper #172 119 places worse
0.8430 ±0.0370
best reported
actual #53 vs paper #172 119 places worse
paper 0.5838
paper 0.5838 Δ at pub 0.2592
60
FAGCN
actual #60 vs paper #65 5 places worse
0.8333
best reported
actual #60 vs paper #65 5 places worse
paper 0.8243
63
GCN
actual #63 vs paper #202 139 places worse
0.8310 ±0.0320
best reported
actual #63 vs paper #202 139 places worse
paper 0.5216
paper 0.5216 Δ at pub 0.3094
69
GraphSAGE
0.8118 ±0.0556
75
GCNII*
actual #75 vs paper #90 15 places worse
0.8039 ±0.0340
best reported
actual #75 vs paper #90 15 places worse
paper 0.7784

Difference within reported uncertainty; not counted as underperformance.

paper 0.7784 Δ at pub 0.0255 Δ today 0.0255
89
PowerEmbed
0.7843
This paper
127
GLGCN
0.7027
This paper
128
GLGAT
0.7001
This paper
139
Geom-GCN
actual #139 vs paper #139
0.6757
actual #139 vs paper #139
paper 0.6757

Improvement within reported uncertainty; not highlighted.

paper 0.6757 Δ at pub 0.0306
169
PairNorm
actual #169 vs paper #169
0.6027
actual #169 vs paper #169
paper 0.6027
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere