On Exploring Node-feature and Graph-structure Diversities for Node Drop Graph Pooling

Chuang Liu, Yibing Zhan, Baosheng Yu, Liu Liu, Bo Du, Wenbin Hu, Tongliang Liu

Main figure for On Exploring Node-feature and Graph-structure Diversities for Node Drop Graph Pooling

Abstract

A pooling operation is essential for effective graph-level representation learning, where the node drop pooling has become one mainstream graph pooling technology. However, current node drop pooling methods usually keep the top-k nodes according to their significance scores, which ignore the graph diversity in terms of the node features and the graph structures, thus resulting in suboptimal graph-level representations. To address the aforementioned issue, we propose a novel plug-and-play score scheme and refer to it as MID, which consists of a Multidimensional score space with two operations, i.e., flIpscore and Dropscore. Specifically, the multidimensional score space depicts the significance of nodes through multiple criteria; the flipscore encourages the maintenance of dissimilar node features; and the dropscore forces the model to notice diverse graph structures instead of being stuck in significant local structures. To evaluate the effectiveness of our proposed MID, we perform extensive experiments by applying it to a wide variety of recent node drop pooling methods, including TopKPool, SAGPool, GSAPool, and ASAP. Specifically, the proposed MID can efficiently and consistently achieve about 2.8\

Benchmark Results

Tested on 3 datasets 14 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
101
TopKPool
actual #101 vs paper #680 579 places worse
0.9130 ±0.0070
best reported
actual #101 vs paper #680 579 places worse
paper 0.7706 ±0.0225
paper 0.7706 ±0.0225 Δ at pub 0.1424
141
MINCUTPOOL
actual #141 vs paper #446 305 places worse
0.9060 ±0.0460
best reported
actual #141 vs paper #446 305 places worse
paper 0.8517 ±0.0141
best at pub: Total Variation Graph Neural Networks (ICML 2022)
paper 0.8517 ±0.0141 Δ at pub 0.0003 Δ today 0.0543
190
SortPool
actual #190 vs paper #758 568 places worse
0.9000 ±0.0224
best reported
actual #190 vs paper #758 568 places worse
paper 0.7056 ±0.0273
202
GMT
actual #202 vs paper #518 316 places worse
0.8990 ±0.0420
best reported
actual #202 vs paper #518 316 places worse
paper 0.8304 ±0.0101
paper 0.8304 ±0.0101 Δ at pub 0.0040 Δ today 0.0686
239
DiffPool
actual #239 vs paper #545 306 places worse
0.8940 ±0.0460
best reported
actual #239 vs paper #545 306 places worse
paper 0.8250 ±0.0254
best at pub: Total Variation Graph Neural Networks (ICML 2022)
paper 0.8250 ±0.0254 Δ at pub 0.0390 Δ today 0.0690
367
ASAP
actual #367 vs paper #638 271 places worse
0.8740 ±0.0570
best reported
actual #367 vs paper #638 271 places worse
paper 0.7933 ±0.0402
paper 0.7933 ±0.0402 Δ at pub 0.0084 Δ today 0.0807
403
MLP
0.8660 ±0.0495
560
ASAP + MID
0.8233 ±0.0340
This paper
589
EdgePool
actual #589 vs paper #741 152 places worse
0.8101 ±0.0082
best reported
actual #589 vs paper #741 152 places worse
paper 0.7300 ±0.0087
paper 0.7300 ±0.0087 Δ at pub 0.0801
593
Set2Set
actual #593 vs paper #759 166 places worse
0.8084 ±0.0067
best reported
actual #593 vs paper #759 166 places worse
paper 0.7050 ±0.0199
paper 0.7050 ±0.0199 Δ at pub 0.0590 Δ today 0.1034
606
TopKPool + MID
0.8038 ±0.0226
This paper
623
SAGPool
actual #623 vs paper #766 143 places worse
0.7986 ±0.0236
best reported
actual #623 vs paper #766 143 places worse
paper 0.6767 ±0.0356
paper 0.6767 ±0.0356 Δ at pub 0.1219
671
HaarPool
actual #671 vs paper #719 48 places worse
0.7760 ±0.0894
best reported
actual #671 vs paper #719 48 places worse
paper 0.7489 ±0.0069
best at pub: Hierarchical Graph Capsule Network (AAAI 2020)

Difference within reported uncertainty; not counted as underperformance.

paper 0.7489 ±0.0069 Δ at pub 0.0271
744
SAGPool + MID
0.7272 ±0.0196
This paper
754
GSAPool + MID
0.7172 ±0.0104
This paper
761
MemPool
0.6917 ±0.0204
This paper
763
GSAPool
0.6883 ±0.0154
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
0.9727
5
DiffPool
actual #5 vs paper #355 350 places worse
0.9210 ±0.0260
best reported
actual #5 vs paper #355 350 places worse
paper 0.7704 ±0.0073
paper 0.7704 ±0.0073 Δ at pub 0.0076 Δ today 0.1506
131
GraphSAGE
0.8200 ±0.0100
226
GMT
actual #226 vs paper #386 160 places worse
0.7990 ±0.0040
best reported
actual #226 vs paper #386 160 places worse
paper 0.7623 ±0.0049
paper 0.7623 ±0.0049 Δ at pub 0.0012 Δ today 0.0367
259
SAGPool
actual #259 vs paper #474 215 places worse
0.7910 ±0.0300
best reported
actual #259 vs paper #474 215 places worse
paper 0.7089 ±0.0080
paper 0.7089 ±0.0080 Δ at pub 0.0821
267
EdgePool
actual #267 vs paper #372 105 places worse
0.7893 ±0.0222
best reported
actual #267 vs paper #372 105 places worse
paper 0.7653 ±0.0050
best today: Graph Parsing Networks (ICLR 2024)

Difference within reported uncertainty; not counted as underperformance.

paper 0.7653 ±0.0050 Δ at pub 0.0126 Δ today 0.0240
295
TopKPool + MID
0.7850 ±0.0050
This paper
309
ASAP
actual #309 vs paper #440 131 places worse
0.7821 ±0.0175
best reported
actual #309 vs paper #440 131 places worse
paper 0.7386 ±0.0074
paper 0.7386 ±0.0074 Δ at pub 0.0435
355
TopKPool
actual #355 vs paper #440 85 places worse
0.7706 ±0.0090
best reported
actual #355 vs paper #440 85 places worse
paper 0.7382 ±0.0065
paper 0.7382 ±0.0065 Δ at pub 0.0324
368
MINCUTPOOL
actual #368 vs paper #469 101 places worse
0.7680 ±0.0160
best reported
actual #368 vs paper #469 101 places worse
paper 0.7115 ±0.0098
paper 0.7115 ±0.0098 Δ at pub 0.0565
403
GSAPool + MID
0.7572 ±0.0092
This paper
408
ASAP + MID
0.7530 ±0.0043
This paper
415
SortPool
actual #415 vs paper #452 37 places worse
0.7496 ±0.0134
best reported
actual #415 vs paper #452 37 places worse
paper 0.7288 ±0.0093
438
SAGPool + MID
0.7408 ±0.0040
This paper
463
Set2Set
actual #463 vs paper #463
0.7170 ±0.0073
actual #463 vs paper #463
paper 0.7170 ±0.0073

Improvement within reported uncertainty; not highlighted.

paper 0.7170 ±0.0073 Δ at pub 0.0020
468
GSAPool
0.7133 ±0.0092
This paper
508
MemPool
0.6765 ±0.0067
This paper
#ModelAccuracy ↑Paper
1
GC-GNN (GCN)
0.9210 ±0.0810
2
SUGAR
0.8403 ±0.0133
3
Ortho-g-U-Nets
0.8387
15
SAGE
0.8088 ±0.0233
18
DiffPool
actual #18 vs paper #174 156 places worse
0.8064
best reported
actual #18 vs paper #174 156 places worse
paper 0.6795 ±0.0244
best at pub: Graph U-Nets (2019)
best today: Orthogonal Graph Neural Networks (AAAI 2021)
paper 0.6795 ±0.0244 Δ at pub 0.1269 Δ today 0.1269
32
ASAP
actual #32 vs paper #120 88 places worse
0.7950 ±0.0180
best reported
actual #32 vs paper #120 88 places worse
paper 0.7591 ±0.0101
paper 0.7591 ±0.0101 Δ at pub 0.0359
41
EdgePool
actual #41 vs paper #105 64 places worse
0.7920 ±0.0261
best reported
actual #41 vs paper #105 64 places worse
paper 0.7697 ±0.0044

Difference within reported uncertainty; not counted as underperformance.

paper 0.7697 ±0.0044 Δ at pub 0.0223
55
GMT
actual #55 vs paper #61 6 places worse
0.7872 ±0.0059
best reported
actual #55 vs paper #61 6 places worse
paper 0.7848 ±0.0048

Difference within reported uncertainty; not counted as underperformance.

paper 0.7848 ±0.0048 Δ at pub 0.0024 Δ today 0.0024
56
SAGPool
actual #56 vs paper #116 60 places worse
0.7870 ±0.0229
best reported
actual #56 vs paper #116 60 places worse
paper 0.7615 ±0.0073

Difference within reported uncertainty; not counted as underperformance.

paper 0.7615 ±0.0073 Δ at pub 0.0255
69
MINCUTPOOL
actual #69 vs paper #140 71 places worse
0.7822 ±0.0054
best reported
actual #69 vs paper #140 71 places worse
paper 0.7469 ±0.0052
paper 0.7469 ±0.0052 Δ at pub 0.0353 Δ today 0.0353
88
ASAP + MID
0.7757 ±0.0079
This paper
90
SortPool
actual #90 vs paper #90
0.7750 ±0.0050
actual #90 vs paper #90
paper 0.7750 ±0.0050
paper 0.7750 ±0.0050 Δ at pub 0.0192
106
SAGPool + MID
0.7697 ±0.0072
This paper
108
GSAPool + MID
0.7670 ±0.0056
This paper
110
TopKPool
actual #110 vs paper #160 50 places worse
0.7640 ±0.0232
best reported
actual #110 vs paper #160 50 places worse
paper 0.7212 ±0.0122
paper 0.7212 ±0.0122 Δ at pub 0.0428
121
GSAPool
0.7591 ±0.0077
This paper
142
TopKPool + MID
0.7465 ±0.0168
This paper
146
Set2Set
actual #146 vs paper #158 12 places worse
0.7450
best reported
actual #146 vs paper #158 12 places worse
paper 0.7265 ±0.0047
paper 0.7265 ±0.0047 Δ at pub 0.0185
156
MemPool
0.7296 ±0.0084
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere