ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations
Abstract
Graph Neural Networks (GNN) have been shown to work effectively for modeling graph structured data to solve tasks such as node classification, link prediction and graph classification. There has been some recent progress in defining the notion of pooling in graphs whereby the model tries to generate a graph level representation by downsampling and summarizing the information present in the nodes. Existing pooling methods either fail to effectively capture the graph substructure or do not easily scale to large graphs. In this work, we propose ASAP (Adaptive Structure Aware Pooling), a sparse and differentiable pooling method that addresses the limitations of previous graph pooling architectures. ASAP utilizes a novel self-attention network along with a modified GNN formulation to capture the importance of each node in a given graph. It also learns a sparse soft cluster assignment for nodes at each layer to effectively pool the subgraphs to form the pooled graph. Through extensive experiments on multiple datasets and theoretical analysis, we motivate our choice of the components used in ASAP. Our experimental results show that combining existing GNN architectures with ASAP leads to state-of-the-art results on multiple graph classification benchmarks. ASAP has an average improvement of 4\
Benchmark Results
Tested on 3 datasets 2 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 | |
| 3 | GCN | 0.9727 | |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 309 | ASAP | 0.7821
±0.0175 best reported | best today: Multi-grained Semantics-aware Graph Neural Networks (2020) |
| 415 | SortPool | 0.7496
±0.0134 best reported | |
| 463 | Set2Set | 0.7170
±0.0073 best reported | best at pub: Graph Convolutional Networks with EigenPooling (KDD 2019) |
| 498 | Global-Attention | 0.6900
±0.0049 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 29 | ASAP | 0.7892
±0.0145 best reported | best today: Multi-grained Semantics-aware Graph Neural Networks (2020) |
| 32 | GIN | 0.7880
±0.0410 | |
| 149 | MLP | 0.7600
±0.0320 | |
| 152 | SortPool | 0.7391
±0.0072 | prev best: Fast Graph Representation Learning with PyTorch Geometric (ICLR 2019) Improvement within reported uncertainty; not highlighted. |
| 301 | Set2Set | 0.7429 best reported | best at pub: Fast Graph Representation Learning with PyTorch Geometric (ICLR 2019) best today: Memory-Based Graph Networks (ICLR 2020) |
| 416 | Global-Attention | 0.7187
±0.0060 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GC-GNN (GCN) | 0.9210
±0.0810 | |
| 2 | SUGAR | 0.8403
±0.0133 | |
| 3 | Ortho-g-U-Nets | 0.8387 | |
| 15 | SAGE | 0.8088
±0.0233 | |
| 32 | ASAP | 0.7950
±0.0180 best reported | best today: Multi-grained Semantics-aware Graph Neural Networks (2020) Difference within reported uncertainty; not counted as underperformance. |
| 90 | SortPool | 0.7750
±0.0050 best reported | |
| 146 | Set2Set | 0.7450 best reported | best at pub: Graph Convolutional Networks with EigenPooling (KDD 2019) |
| 165 | Global-Attention | 0.7138
±0.0078 | This paper |
