KDD 2019

Graph Convolutional Networks with EigenPooling

Yao Ma, Suhang Wang, Charu C. Aggarwal, Jiliang Tang

Main figure for Graph Convolutional Networks with EigenPooling

Abstract

Graph neural networks, which generalize deep neural network models to graph structured data, have attracted increasing attention in recent years. They usually learn node representations by transforming, propagating and aggregating node features and have been proven to improve the performance of many graph related tasks such as node classification and link prediction. To apply graph neural networks for the graph classification task, approaches to generate the graph representation from node representations are demanded. A common way is to globally combine the node representations. However, rich structural information is overlooked. Thus a hierarchical pooling procedure is desired to preserve the graph structure during the graph representation learning. There are some recent works on hierarchically learning graph representation analogous to the pooling step in conventional convolutional neural (CNN) networks. However, the local structural information is still largely neglected during the pooling process. In this paper, we introduce a pooling operator $ $ based on graph Fourier transform, which can utilize the node features and local structures during the pooling process. We then design pooling layers based on the pooling operator, which are further combined with traditional GCN convolutional layers to form a graph neural network framework $ $ for graph classification. Theoretical analysis is provided to understand $ $ from both local and global perspectives. Experimental results of the graph classification task on $6$ commonly used benchmarks demonstrate the effectiveness of the proposed framework.

Benchmark Results

Tested on 5 datasets 4 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
63
GCN
actual #63 vs paper #661 598 places worse
0.9220 ±0.0440
best reported
actual #63 vs paper #661 598 places worse
paper 0.7800
paper 0.7800 Δ at pub 0.0770 Δ today 0.1420
158
GraphSAGE
actual #158 vs paper #652 494 places worse
0.9040 ±0.0780
best reported
actual #158 vs paper #652 494 places worse
paper 0.7850

Difference within reported uncertainty; not counted as underperformance.

paper 0.7850 Δ at pub 0.0720 Δ today 0.1190
403
MLP
0.8660 ±0.0495
425
DGCNN
actual #425 vs paper #650 225 places worse
0.8583 ±0.0116
best reported
actual #425 vs paper #650 225 places worse
paper 0.7880
593
Set2Set
actual #593 vs paper #687 94 places worse
0.7640
actual #593 vs paper #687 94 places worse
paper 0.7640

Improvement within reported uncertainty; not highlighted.

paper 0.7640 Δ at pub 0.0270 Δ today 0.0444
598
Diff-pool
0.8060
This paper
613
EigenPooling-1
0.8010
This paper
637
EigenPooling-3
0.7950
This paper
650
EigenPooling-2
0.7890
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
actual #3 vs paper #459 456 places worse
0.9727
best reported
actual #3 vs paper #459 456 places worse
paper 0.7250
paper 0.7250 Δ today 0.2477
131
GraphSAGE
actual #131 vs paper #446 315 places worse
0.8200 ±0.0100
best reported
actual #131 vs paper #446 315 places worse
paper 0.7320
paper 0.7320 Δ today 0.0880
365
EigenPooling-3
0.7700
This paper
371
EigenPooling-2
0.7670
This paper
373
DGCNN
actual #373 vs paper #452 79 places worse
0.7650 ±0.0190
best reported
actual #373 vs paper #452 79 places worse
paper 0.7290
396
EigenPooling-1
0.7600
This paper
393
Diff-pool
0.7600
This paper
463
Set2Set
actual #463 vs paper #465 2 places worse
0.7170 ±0.0073
best reported
actual #463 vs paper #465 2 places worse
paper 0.7150

Difference within reported uncertainty; not counted as underperformance.

paper 0.7150 Δ today 0.0020
#ModelAccuracy ↑Paper
1
MSH-GNN
0.9410 ±0.0330
2
GRDL
0.8260 ±0.0120
3
GMN
0.8225
32
GIN
0.7880 ±0.0410
104
EigenPooling-3
0.7660
This paper
132
DGCNN
actual #132 vs paper #356 224 places worse
0.7626
best reported
actual #132 vs paper #356 224 places worse
paper 0.7320
best today: Orthogonal Graph Neural Networks (AAAI 2021)
paper 0.7320 Δ today 0.0306
148
GCN
actual #148 vs paper #309 161 places worse
0.7400
actual #148 vs paper #309 161 places worse
paper 0.7400

Improvement within reported uncertainty; not highlighted.

paper 0.7400 Δ at pub 0.0090
149
MLP
0.7600 ±0.0320
155
GraphSAGE
actual #155 vs paper #282 127 places worse
0.7460
actual #155 vs paper #282 127 places worse
paper 0.7460

Improvement within reported uncertainty; not highlighted.

paper 0.7460 Δ at pub 0.0440
160
Diff-pool
0.7590
This paper
205
EigenPooling-2
0.7540
This paper
239
EigenPooling-1
0.7510
This paper
301
Set2Set
actual #301 vs paper #376 75 places worse
0.7429
best reported
actual #301 vs paper #376 75 places worse
paper 0.7270
best today: Memory-Based Graph Networks (ICLR 2020)
paper 0.7270 Δ at pub 0.0090 Δ today 0.0159
#ModelAccuracy ↑Paper
1
GMN
0.7866
2
MemGNN
0.7550
3
TFGW SP
0.7510 ±0.0500
17
GatedGCN
0.7000 ±0.0494
26
GraphSAGE
actual #26 vs paper #126 100 places worse
0.6817 ±0.0545
best reported
actual #26 vs paper #126 100 places worse
paper 0.5540
best today: GNNBenchmark (JMLR 2023)
paper 0.5540 Δ at pub 0.0490 Δ today 0.1277
32
GIN
0.6767 ±0.0583
36
GCN
actual #36 vs paper #173 137 places worse
0.6650 ±0.0691
best reported
actual #36 vs paper #173 137 places worse
paper 0.4400
best today: Hierarchical Graph Capsule Network (AAAI 2020)
paper 0.4400 Δ at pub 0.0900 Δ today 0.2250
50
EigenPooling-1
0.6500
This paper
55
EigenPooling-2
0.6450
This paper
56
EigenPooling-3
0.6450
This paper
61
Diff-pool
0.6360
This paper
93
Set2Set
actual #93 vs paper #196 103 places worse
0.6015
best reported
actual #93 vs paper #196 103 places worse
paper 0.3800
best today: Memory-Based Graph Networks (ICLR 2020)
paper 0.3800 Δ today 0.2215
119
DGCNN
actual #119 vs paper #184 65 places worse
0.5712
best reported
actual #119 vs paper #184 65 places worse
paper 0.4100
124
MLP
0.5583 ±0.0352
#ModelAccuracy ↑Paper
1
GC-GNN (GCN)
0.9210 ±0.0810
2
SUGAR
0.8403 ±0.0133
3
Ortho-g-U-Nets
0.8387
15
SAGE
0.8088 ±0.0233
37
DGCNN
actual #37 vs paper #79 42 places worse
0.7937
best reported
actual #37 vs paper #79 42 places worse
paper 0.7780
best today: Orthogonal Graph Neural Networks (AAAI 2021)
paper 0.7780 Δ at pub 0.0157 Δ today 0.0157
43
GCN
actual #43 vs paper #121 78 places worse
0.7590
actual #43 vs paper #121 78 places worse
paper 0.7590

Improvement within reported uncertainty; not highlighted.

paper 0.7590 Δ at pub 0.0120
59
EigenPooling-3
0.7860
This paper
75
Diff-pool
0.7800
This paper
91
EigenPooling-1
0.7750
This paper
105
EigenPooling-2
0.7700
This paper
109
GraphSAGE
actual #109 vs paper #109
0.7660
actual #109 vs paper #109
paper 0.7660

Improvement within reported uncertainty; not highlighted.

paper 0.7660 Δ at pub 0.0300
146
Set2Set
0.7450
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere