AAAI 2019

ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations

Ekagra Ranjan, Soumya Sanyal, P. Talukdar

Main figure for ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations

Abstract

Graph Neural Networks (GNN) have been shown to work effectively for modeling graph structured data to solve tasks such as node classification, link prediction and graph classification. There has been some recent progress in defining the notion of pooling in graphs whereby the model tries to generate a graph level representation by downsampling and summarizing the information present in the nodes. Existing pooling methods either fail to effectively capture the graph substructure or do not easily scale to large graphs. In this work, we propose ASAP (Adaptive Structure Aware Pooling), a sparse and differentiable pooling method that addresses the limitations of previous graph pooling architectures. ASAP utilizes a novel self-attention network along with a modified GNN formulation to capture the importance of each node in a given graph. It also learns a sparse soft cluster assignment for nodes at each layer to effectively pool the subgraphs to form the pooled graph. Through extensive experiments on multiple datasets and theoretical analysis, we motivate our choice of the components used in ASAP. Our experimental results show that combining existing GNN architectures with ASAP leads to state-of-the-art results on multiple graph classification benchmarks. ASAP has an average improvement of 4\

Proposed method: ASAP

Benchmark Results

Tested on 3 datasets 2 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
0.9727
131
GraphSAGE
0.8200 ±0.0100
309
ASAP
actual #309 vs paper #465 156 places worse
0.7821 ±0.0175
best reported
actual #309 vs paper #465 156 places worse
paper 0.7148 ±0.0042
paper 0.7148 ±0.0042 Δ today 0.0673
415
SortPool
actual #415 vs paper #501 86 places worse
0.7496 ±0.0134
best reported
actual #415 vs paper #501 86 places worse
paper 0.6874 ±0.0107
463
Set2Set
actual #463 vs paper #511 48 places worse
0.7170 ±0.0073
best reported
actual #463 vs paper #511 48 places worse
paper 0.6697 ±0.0074
paper 0.6697 ±0.0074 Δ at pub 0.0453 Δ today 0.0473
498
Global-Attention
0.6900 ±0.0049
This paper
#ModelAccuracy ↑Paper
1
MSH-GNN
0.9410 ±0.0330
2
GRDL
0.8260 ±0.0120
3
GMN
0.8225
29
ASAP
actual #29 vs paper #308 279 places worse
0.7892 ±0.0145
best reported
actual #29 vs paper #308 279 places worse
paper 0.7419 ±0.0079
paper 0.7419 ±0.0079 Δ today 0.0473
32
GIN
0.7880 ±0.0410
149
MLP
0.7600 ±0.0320
152
SortPool
actual #152 vs paper #320 168 places worse
0.7391 ±0.0072
actual #152 vs paper #320 168 places worse
paper 0.7391 ±0.0072

Improvement within reported uncertainty; not highlighted.

paper 0.7391 ±0.0072 Δ at pub 0.0151
301
Set2Set
actual #301 vs paper #403 102 places worse
0.7429
best reported
actual #301 vs paper #403 102 places worse
paper 0.7216 ±0.0043
best today: Memory-Based Graph Networks (ICLR 2020)
paper 0.7216 ±0.0043 Δ at pub 0.0144 Δ today 0.0213
416
Global-Attention
0.7187 ±0.0060
This paper
#ModelAccuracy ↑Paper
1
GC-GNN (GCN)
0.9210 ±0.0810
2
SUGAR
0.8403 ±0.0133
3
Ortho-g-U-Nets
0.8387
15
SAGE
0.8088 ±0.0233
32
ASAP
actual #32 vs paper #106 74 places worse
0.7950 ±0.0180
best reported
actual #32 vs paper #106 74 places worse
paper 0.7687 ±0.0070

Difference within reported uncertainty; not counted as underperformance.

paper 0.7687 ±0.0070 Δ today 0.0263
90
SortPool
actual #90 vs paper #161 71 places worse
0.7750 ±0.0050
best reported
actual #90 vs paper #161 71 places worse
paper 0.7187 ±0.0096
146
Set2Set
actual #146 vs paper #161 15 places worse
0.7450
best reported
actual #146 vs paper #161 15 places worse
paper 0.7160 ±0.0087
paper 0.7160 ±0.0087 Δ at pub 0.0290
165
Global-Attention
0.7138 ±0.0078
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere