The Expressive Power of Graph Neural Networks: A Survey

Bingxue Zhang, Changjun Fan, Shixuan Liu, Kuihua Huang, Xiang Zhao, Jincai Huang, Zhong Liu

Main figure for The Expressive Power of Graph Neural Networks: A Survey

Abstract

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power. Early works in this domain mainly focus on studying the graph isomorphism recognition ability of GNNs, and recent works try to leverage the properties such as subgraph counting and connectivity learning to characterize the expressive power of GNNs, which are more practical and closer to real-world. However, no survey papers and open-source repositories comprehensively summarize and discuss models in this important direction. To fill the gap, we conduct a first survey for models for enhancing expressive power under different forms of definition. Concretely, the models are reviewed based on three categories, i.e., Graph feature enhancement, Graph topology enhancement, and GNNs architecture enhancement.

Benchmark Results

Tested on 6 datasets 16 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #599 578 places worse
0.9004
best reported
actual #21 vs paper #599 578 places worse
paper 0.8110 ±0.0030
best at pub: Language is All a Graph Needs (2023)
paper 0.8110 ±0.0030 Δ at pub 0.0668 Δ today 0.0894
39
SAGE
0.8911 ±0.0012
44
GAT
actual #44 vs paper #578 534 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #578 534 places worse
paper 0.8140 ±0.0100
paper 0.8140 ±0.0100 Δ at pub 0.0750 Δ today 0.0757
141
GraphSAGE
actual #141 vs paper #636 495 places worse
0.8708 ±0.0085
best reported
actual #141 vs paper #636 495 places worse
paper 0.8040 ±0.0040
145
ID-GNN
0.8700 ±0.2200
This paper
165
GIN
actual #165 vs paper #741 576 places worse
0.8660 ±0.0091
best reported
actual #165 vs paper #741 576 places worse
paper 0.7680 ±0.0090
paper 0.7680 ±0.0090 Δ at pub 0.0500 Δ today 0.0980
207
Geom-GCN
actual #207 vs paper #207
0.8540 ±0.0040
actual #207 vs paper #207
paper 0.8540 ±0.0040

Improvement within reported uncertainty; not highlighted.

paper 0.8540 ±0.0040 Δ at pub 0.0010
282
MM-GNN
0.8420 ±0.0060
This paper
304
GNN-HF
0.8400 ±0.0020
This paper
316
GraphSNN
actual #316 vs paper #316
0.8380 ±0.0120
actual #316 vs paper #316
paper 0.8380 ±0.0120
prev best: Union Subgraph Neural Networks (AAAI 2023)
paper 0.8380 ±0.0120 Δ at pub 0.0836
328
GNN-LF
0.8370 ±0.0010
This paper
509
PEG
0.8220 ±0.0010
This paper
698
Eigen-GNN
0.7890 ±0.0070
This paper
724
MLP
0.7768
777
CL-GNN
0.7480 ±0.0010
This paper
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
15
GNN-LF
actual #15 vs paper #457 442 places worse
0.8366 ±0.0006
best reported
actual #15 vs paper #457 442 places worse
paper 0.7200 ±0.0030
paper 0.7200 ±0.0030 Δ at pub 0.1166
16
GNN-HF
actual #16 vs paper #426 410 places worse
0.8356 ±0.0010
best reported
actual #16 vs paper #426 410 places worse
paper 0.7230 ±0.0030
paper 0.7230 ±0.0030 Δ at pub 0.1126
35
GAT
actual #35 vs paper #561 526 places worse
0.8080 ±0.0026
best reported
actual #35 vs paper #561 526 places worse
paper 0.7090 ±0.0070
paper 0.7090 ±0.0070 Δ at pub 0.0990
44
GCN
actual #44 vs paper #616 572 places worse
0.8033 ±0.0088
best reported
actual #44 vs paper #616 572 places worse
paper 0.7010 ±0.0040
paper 0.7010 ±0.0040 Δ at pub 0.0933 Δ today 0.1023
61
GraphSAGE
actual #61 vs paper #634 573 places worse
0.7923 ±0.0053
best reported
actual #61 vs paper #634 573 places worse
paper 0.6960 ±0.0030
paper 0.6960 ±0.0030 Δ at pub 0.0963
88
Geom-GCN
actual #88 vs paper #135 47 places worse
0.7799 ±0.0115
best reported
actual #88 vs paper #135 47 places worse
paper 0.7600 ±0.0150

Difference within reported uncertainty; not counted as underperformance.

paper 0.7600 ±0.0150 Δ at pub 0.0199 Δ today 0.0199
203
AM-GCN
0.7450 ±0.0100
This paper
218
ID-GNN
0.7420 ±0.0100
This paper
259
SAGE
0.7361 ±0.0190
275
GraphSNN
actual #275 vs paper #275
0.7350 ±0.0160
actual #275 vs paper #275
paper 0.7350 ±0.0160
prev best: Union Subgraph Neural Networks (AAAI 2023)
paper 0.7350 ±0.0160 Δ at pub 0.0882
329
MM-GNN
0.7300 ±0.0060
This paper
350
MLP
0.7289 ±0.0010
389
GIN
actual #389 vs paper #696 307 places worse
0.7250 ±0.0080
best reported
actual #389 vs paper #696 307 places worse
paper 0.6770 ±0.0030
paper 0.6770 ±0.0030 Δ at pub 0.0480
468
PEG
0.7190 ±0.0010
This paper
732
Eigen-GNN
0.6650 ±0.0030
This paper
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
actual #18 vs paper #628 610 places worse
0.9296 ±0.0015
best reported
actual #18 vs paper #628 610 places worse
paper 0.7860 ±0.0060
20
GAT
actual #20 vs paper #661 641 places worse
0.9233 ±0.0018
best reported
actual #20 vs paper #661 641 places worse
paper 0.7820 ±0.0080
69
Geom-GCN
actual #69 vs paper #160 91 places worse
0.9005 ±0.0047
best reported
actual #69 vs paper #160 91 places worse
paper 0.8790 ±0.0250

Difference within reported uncertainty; not counted as underperformance.

paper 0.8790 ±0.0250 Δ at pub 0.0215 Δ today 0.0215
116
SAGE
0.8881 ±0.0015
125
GraphSAGE
actual #125 vs paper #711 586 places worse
0.8864 ±0.0030
best reported
actual #125 vs paper #711 586 places worse
paper 0.7750 ±0.0080
paper 0.7750 ±0.0080 Δ at pub 0.1015 Δ today 0.1114
157
GIN
actual #157 vs paper #739 582 places worse
0.8810
best reported
actual #157 vs paper #739 582 places worse
paper 0.7700 ±0.0050
paper 0.7700 ±0.0050 Δ at pub 0.0376 Δ today 0.1110
163
GNN-HF
actual #163 vs paper #410 247 places worse
0.8783 ±0.0010
best reported
actual #163 vs paper #410 247 places worse
paper 0.8040 ±0.0030
paper 0.8040 ±0.0030 Δ at pub 0.0743
168
GNN-LF
actual #168 vs paper #418 250 places worse
0.8779 ±0.0005
best reported
actual #168 vs paper #418 250 places worse
paper 0.8030 ±0.0020
paper 0.8030 ±0.0020 Δ at pub 0.0749
210
MLP
0.8690 ±0.0074
422
MM-GNN
0.8030 ±0.0070
This paper
463
PEG
0.7990 ±0.0010
This paper
489
GraphSNN
actual #489 vs paper #489
0.7960 ±0.0140
actual #489 vs paper #489
paper 0.7960 ±0.0140
prev best: Union Subgraph Neural Networks (AAAI 2023)
paper 0.7960 ±0.0140 Δ at pub 0.0284
629
Eigen-GNN
0.7860 ±0.0010
This paper
756
CL-GNN
0.7650 ±0.0020
This paper
#ModelMAE ↓Paper
1
TIGT
0.0140 ±0.0010
2
FloydNet
0.0160
3
GSSC
0.0190 ±0.0010
54
IGN
0.0450 ±0.0060
This paper
69
GIN
0.0880 ±0.0020

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
4
ID-GNN
actual #4 vs paper #157 153 places worse
0.9780 ±0.0370
best reported
actual #4 vs paper #157 153 places worse
paper 0.9040 ±0.0540

Difference within reported uncertainty; not counted as underperformance.

paper 0.9040 ±0.0540 Δ today 0.0740
12
KP-GNN
0.9610 ±0.0460
This paper
20
SAGNN
0.9520 ±0.0300
This paper
24
GraphSNN
actual #24 vs paper #24
0.9470 ±0.0190
actual #24 vs paper #24
paper 0.9470 ±0.0190
prev best: Union Subgraph Neural Networks (AAAI 2023)
paper 0.9470 ±0.0190 Δ at pub 0.1066
32
CLIP
0.9390 ±0.0400
This paper
39
GIN
actual #39 vs paper #237 198 places worse
0.9330 ±0.0290
best reported
actual #39 vs paper #237 198 places worse
paper 0.8940 ±0.0560

Difference within reported uncertainty; not counted as underperformance.

paper 0.8940 ±0.0560 Δ at pub 0.0390
63
GCN
actual #63 vs paper #271 208 places worse
0.9220 ±0.0440
best reported
actual #63 vs paper #271 208 places worse
paper 0.8910 ±0.0580

Difference within reported uncertainty; not counted as underperformance.

paper 0.8910 ±0.0580 Δ today 0.0310
64
GSN
0.9220 ±0.0750
This paper
73
ESAN
actual #73 vs paper #105 32 places worse
0.9200 ±0.0500
best reported
actual #73 vs paper #105 32 places worse
paper 0.9110 ±0.0700

Difference within reported uncertainty; not counted as underperformance.

paper 0.9110 ±0.0700 Δ at pub 0.0090
103
GNN-AK+
0.9130 ±0.0700
This paper
128
GNNML3
0.9090 ±0.0550
This paper
140
PPGN
0.9060 ±0.0870
This paper
158
GraphSAGE
actual #158 vs paper #446 288 places worse
0.9040 ±0.0780
best reported
actual #158 vs paper #446 288 places worse
paper 0.8510 ±0.0760

Difference within reported uncertainty; not counted as underperformance.

paper 0.8510 ±0.0760 Δ at pub 0.0530
183
GAT
0.9010 ±0.0580
This paper
193
Twin-GNN
0.9000 ±0.0390
This paper
194
GNNML1
0.9000 ±0.0430
This paper
336
NGNN
0.8790 ±0.0820
This paper
359
3-hop GNN
0.8760 ±0.0070
This paper
398
Ring-GNN
0.8680 ±0.0640
This paper
403
MLP
0.8660 ±0.0495
420
3-GNN
0.8610 ±0.0010
This paper
492
IGN
0.8390 ±0.1300
This paper
718
SAGE
0.7490 ±0.0870
745
SUN
0.7270 ±0.0580
This paper
#ModelAccuracy ↑Paper
1
MSH-GNN
0.9410 ±0.0330
2
GRDL
0.8260 ±0.0120
3
GMN
0.8225
15
KP-GNN
0.8010 ±0.0430
This paper
22
SAGNN
0.7980 ±0.0380
This paper
33
PIN
0.7880 ±0.0440
This paper
32
GIN
actual #32 vs paper #135 103 places worse
0.7880 ±0.0410
best reported
actual #32 vs paper #135 103 places worse
paper 0.7620 ±0.0280

Difference within reported uncertainty; not counted as underperformance.

paper 0.7620 ±0.0280 Δ at pub 0.0080 Δ today 0.0260
39
GraphSNN
actual #39 vs paper #40 1 place worse
0.7840 ±0.0270
actual #39 vs paper #40 1 place worse
paper 0.7840 ±0.0270
prev best: Union Subgraph Neural Networks (AAAI 2023)
paper 0.7840 ±0.0270 Δ at pub 0.0662
49
GAT
actual #49 vs paper #154 105 places worse
0.7800 ±0.0300
best reported
actual #49 vs paper #154 105 places worse
paper 0.7590 ±0.0430

Difference within reported uncertainty; not counted as underperformance.

paper 0.7590 ±0.0430 Δ at pub 0.0210
67
SAGE
0.7726 ±0.0228
73
PPGN
0.7720 ±0.0470
This paper
79
CLIP
0.7710 ±0.0440
This paper
80
GNN-AK+
0.7710 ±0.0570
This paper
78
ESAN
actual #78 vs paper #154 76 places worse
0.7710 ±0.0460
best reported
actual #78 vs paper #154 76 places worse
paper 0.7590 ±0.0430

Difference within reported uncertainty; not counted as underperformance.

paper 0.7590 ±0.0430 Δ today 0.0120
92
PG-GNN
0.7680 ±0.0380
This paper
102
GSN
0.7660 ±0.0500
This paper
100
IGN
0.7660 ±0.0550
This paper
119
MPSN
0.7640 ±0.0330
This paper
120
GNNML3
0.7640 ±0.0510
This paper
148
GCN
actual #148 vs paper #224 76 places worse
0.7600 ±0.0320
best reported
actual #148 vs paper #224 76 places worse
paper 0.7520 ±0.0510

Difference within reported uncertainty; not counted as underperformance.

paper 0.7520 ±0.0510 Δ at pub 0.0080 Δ today 0.0080
149
MLP
0.7600 ±0.0320
155
GraphSAGE
actual #155 vs paper #464 309 places worse
0.7590 ±0.0320
best reported
actual #155 vs paper #464 309 places worse
paper 0.6920 ±0.1000

Difference within reported uncertainty; not counted as underperformance.

paper 0.6920 ±0.1000 Δ at pub 0.0670 Δ today 0.0670
165
SUN
0.7580 ±0.0500
This paper
166
GNNML1
0.7580 ±0.0490
This paper
176
Ring-GNN
0.7570 ±0.0290
This paper
192
3-GNN
0.7550 ±0.0010
This paper
203
ID-GNN
0.7540 ±0.0270
This paper
214
3-hop GNN
0.7530 ±0.0040
This paper
305
NGNN
0.7420 ±0.0370
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published