ICEPool: Enhancing Graph Pooling Networks with Inter-cluster Connectivity

Michael Yang

Main figure for ICEPool: Enhancing Graph Pooling Networks with Inter-cluster Connectivity

Abstract

Hierarchical Pooling Models have demonstrated strong performance in classifying graph-structured data. While numerous innovative methods have been proposed to design cluster assignments and coarsening strategies, the relationships between clusters are often overlooked. In this paper, we introduce Inter-cluster Connectivity Enhancement Pooling (ICEPool), a novel hierarchical pooling framework designed to enhance model's understanding of inter-cluster connectivity and ability of preserving the structural integrity in the original graph. ICEPool is compatible with a wide range of pooling-based GNN models. The deployment of ICEPool as an enhancement to existing models effectively combines the strengths of the original model with ICEPool's capability to emphasize the integration of inter-cluster connectivity, resulting in a more comprehensive and robust graph-level representation. Moreover, we make theoretical analysis to ICEPool's ability of graph reconstruction to demonstrate its effectiveness in learning inter-cluster relationship that is overlooked by conventional models. Finally, the experimental results show the compatibility of ICEPool with wide varieties of models and its potential to boost the performance of existing graph neural network architectures.

Benchmark Results

Tested on 7 datasets 4 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
239
DiffPool
actual #239 vs paper #639 400 places worse
0.8940 ±0.0460
best reported
actual #239 vs paper #639 400 places worse
paper 0.7929 ±0.0124
paper 0.7929 ±0.0124 Δ at pub 0.1011
377
SEP-G ICE
0.8722 ±0.0139
This paper
403
MLP
0.8660 ±0.0495
437
SEP-G
0.8556 ±0.0109
This paper
604
DiffPool ICE (GAT)
0.8042 ±0.0140
This paper
607
DiffPool-det +Both (GAT)
0.8037 ±0.0129
This paper
617
DiffPool-det +CEGAT (GAT)
0.7995 ±0.0108
This paper
629
DiffPool-det +SVDPool
0.7980 ±0.0206
This paper
654
DiffPool-Det
0.7847 ±0.0151
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
0.9727
5
DiffPool
actual #5 vs paper #371 366 places worse
0.9210 ±0.0260
best reported
actual #5 vs paper #371 366 places worse
paper 0.7667 ±0.0188
paper 0.7667 ±0.0188 Δ at pub 0.1543
131
GraphSAGE
0.8200 ±0.0100
247
SEP-G ICE
0.7954 ±0.0085
This paper
300
DiffPool ICE (GAT)
0.7844 ±0.0117
This paper
304
SEP-G
0.7835 ±0.0033
This paper
324
DiffPool-det +CEGAT (GAT)
0.7798 ±0.0134
This paper
353
DiffPool-det +Both (GAT)
0.7720 ±0.0245
This paper
401
DiffPool-det +SVDPool
0.7577 ±0.0158
This paper
404
DiffPool-Det
0.7564 ±0.0109
This paper
#ModelAccuracy ↑Paper
1
MSH-GNN
0.9410 ±0.0330
2
GRDL
0.8260 ±0.0120
3
GMN
0.8225
7
DiffPool
actual #7 vs paper #354 347 places worse
0.8161 ±0.0232
best reported
actual #7 vs paper #354 347 places worse
paper 0.7324 ±0.0135
32
GIN
0.7880 ±0.0410
70
SEP-G ICE
0.7721 ±0.0108
This paper
114
SEP-G
0.7642 ±0.0039
This paper
149
MLP
0.7600 ±0.0320
211
+CEGAT (GAT)
0.7532 ±0.0261
This paper
254
DiffPool ICE (GAT)
0.7496 ±0.0184
This paper
279
+Both (GAT)
0.7468 ±0.0115
This paper
335
DiffPool-Det
0.7360 ±0.0107
This paper
385
+SVDPool
0.7252 ±0.0241
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9792
2
MSH-GNN
0.9640 ±0.0070
3
CoCN
0.8722 ±0.0013
23
GCN
0.8260 ±0.0220
41
SEP-G ICE
0.8176 ±0.0081
This paper
70
SEP-G
0.8128 ±0.0015
This paper
151
MLP
0.7920 ±0.0240
#ModelAccuracy ↑Paper
1
GC-GNN (GCN)
0.9210 ±0.0810
2
SUGAR
0.8403 ±0.0133
3
Ortho-g-U-Nets
0.8387
15
SAGE
0.8088 ±0.0233
18
DiffPool
actual #18 vs paper #78 60 places worse
0.8064
best reported
actual #18 vs paper #78 60 places worse
paper 0.7795 ±0.0103
best at pub: Graph U-Nets (2019)
best today: Orthogonal Graph Neural Networks (AAAI 2021)
paper 0.7795 ±0.0103 Δ at pub 0.0269 Δ today 0.0269
64
SEP-G ICE
0.7844 ±0.0063
This paper
70
DiffPool ICE (EGAT)
0.7821 ±0.0118
This paper
77
SEP-G
0.7798 ±0.0057
This paper
111
DiffPool-det +CEGAT (GAT)
0.7632 ±0.0178
This paper
116
DiffPool-det +SVDPool
0.7616 ±0.0112
This paper
117
DiffPool-Det
actual #117 vs paper #117
0.7615 ±0.0105
actual #117 vs paper #117
paper 0.7615 ±0.0105
prev best: Graph U-Nets (2019)

Improvement within reported uncertainty; not highlighted.

paper 0.7615 ±0.0105 Δ at pub 0.0068
122
DiffPool-det +Both (GAT)
0.7590 ±0.0115
This paper
#ModelAccuracy ↑Paper
1
ID-GNN+BEC
0.8150 ±0.0240
2
GIN+BEC
0.8080 ±0.0330
3
GCN+BEC
0.7990 ±0.0340
4
GCN
0.7980 ±0.0230
40
SEP-G ICE
0.7490 ±0.0085
This paper
55
SEP-G
0.7412 ±0.0056
This paper
#ModelAccuracy ↑Paper
1
GraphSNN
0.7790 ±0.0360
2
SIN
0.7560 ±0.0320
3
CIN
0.7560 ±0.0370
5
GIN
0.7510 ±0.0510
30
SEP-G ICE
0.5247 ±0.0100
This paper
41
SEP-G
0.5153 ±0.0065
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green)