ICEPool: Enhancing Graph Pooling Networks with Inter-cluster Connectivity
Abstract
Hierarchical Pooling Models have demonstrated strong performance in classifying graph-structured data. While numerous innovative methods have been proposed to design cluster assignments and coarsening strategies, the relationships between clusters are often overlooked. In this paper, we introduce Inter-cluster Connectivity Enhancement Pooling (ICEPool), a novel hierarchical pooling framework designed to enhance model's understanding of inter-cluster connectivity and ability of preserving the structural integrity in the original graph. ICEPool is compatible with a wide range of pooling-based GNN models. The deployment of ICEPool as an enhancement to existing models effectively combines the strengths of the original model with ICEPool's capability to emphasize the integration of inter-cluster connectivity, resulting in a more comprehensive and robust graph-level representation. Moreover, we make theoretical analysis to ICEPool's ability of graph reconstruction to demonstrate its effectiveness in learning inter-cluster relationship that is overlooked by conventional models. Finally, the experimental results show the compatibility of ICEPool with wide varieties of models and its potential to boost the performance of existing graph neural network architectures.
Benchmark Results
Tested on 7 datasets 4 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 | |
| 239 | DiffPool | 0.8940
±0.0460 best reported | best at pub: Graph Classification via Reference Distribution Learning: Theory and Practice (NeurIPS 2024) |
| 377 | SEP-G ICE | 0.8722
±0.0139 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 437 | SEP-G | 0.8556
±0.0109 | This paper |
| 604 | DiffPool ICE (GAT) | 0.8042
±0.0140 | This paper |
| 607 | DiffPool-det +Both (GAT) | 0.8037
±0.0129 | This paper |
| 617 | DiffPool-det +CEGAT (GAT) | 0.7995
±0.0108 | This paper |
| 629 | DiffPool-det +SVDPool | 0.7980
±0.0206 | This paper |
| 654 | DiffPool-Det | 0.7847
±0.0151 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 | |
| 3 | GCN | 0.9727 | |
| 5 | DiffPool | 0.9210
±0.0260 best reported | best at pub: Where to Mask: Structure-Guided Masking for Graph Masked Autoencoders (IJCAI 2024) |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 247 | SEP-G ICE | 0.7954
±0.0085 | This paper |
| 300 | DiffPool ICE (GAT) | 0.7844
±0.0117 | This paper |
| 304 | SEP-G | 0.7835
±0.0033 | This paper |
| 324 | DiffPool-det +CEGAT (GAT) | 0.7798
±0.0134 | This paper |
| 353 | DiffPool-det +Both (GAT) | 0.7720
±0.0245 | This paper |
| 401 | DiffPool-det +SVDPool | 0.7577
±0.0158 | This paper |
| 404 | DiffPool-Det | 0.7564
±0.0109 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 7 | DiffPool | 0.8161
±0.0232 best reported | |
| 32 | GIN | 0.7880
±0.0410 | |
| 70 | SEP-G ICE | 0.7721
±0.0108 | This paper |
| 114 | SEP-G | 0.7642
±0.0039 | This paper |
| 149 | MLP | 0.7600
±0.0320 | |
| 211 | +CEGAT (GAT) | 0.7532
±0.0261 | This paper |
| 254 | DiffPool ICE (GAT) | 0.7496
±0.0184 | This paper |
| 279 | +Both (GAT) | 0.7468
±0.0115 | This paper |
| 335 | DiffPool-Det | 0.7360
±0.0107 | This paper |
| 385 | +SVDPool | 0.7252
±0.0241 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 23 | GCN | 0.8260
±0.0220 | |
| 41 | SEP-G ICE | 0.8176
±0.0081 | This paper |
| 70 | SEP-G | 0.8128
±0.0015 | This paper |
| 151 | MLP | 0.7920
±0.0240 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GC-GNN (GCN) | 0.9210
±0.0810 | |
| 2 | SUGAR | 0.8403
±0.0133 | |
| 3 | Ortho-g-U-Nets | 0.8387 | |
| 15 | SAGE | 0.8088
±0.0233 | |
| 18 | DiffPool | 0.8064 best reported | best at pub: Graph U-Nets (2019) best today: Orthogonal Graph Neural Networks (AAAI 2021) |
| 64 | SEP-G ICE | 0.7844
±0.0063 | This paper |
| 70 | DiffPool ICE (EGAT) | 0.7821
±0.0118 | This paper |
| 77 | SEP-G | 0.7798
±0.0057 | This paper |
| 111 | DiffPool-det +CEGAT (GAT) | 0.7632
±0.0178 | This paper |
| 116 | DiffPool-det +SVDPool | 0.7616
±0.0112 | This paper |
| 117 | DiffPool-Det | 0.7615
±0.0105 | prev best: Graph U-Nets (2019) Improvement within reported uncertainty; not highlighted. |
| 122 | DiffPool-det +Both (GAT) | 0.7590
±0.0115 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | ID-GNN+BEC | 0.8150
±0.0240 | |
| 2 | GIN+BEC | 0.8080
±0.0330 | |
| 3 | GCN+BEC | 0.7990
±0.0340 | |
| 4 | GCN | 0.7980
±0.0230 | |
| 40 | SEP-G ICE | 0.7490
±0.0085 | This paper |
| 55 | SEP-G | 0.7412
±0.0056 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSNN | 0.7790
±0.0360 | |
| 2 | SIN | 0.7560
±0.0320 | |
| 3 | CIN | 0.7560
±0.0370 | |
| 5 | GIN | 0.7510
±0.0510 | |
| 30 | SEP-G ICE | 0.5247
±0.0100 | This paper |
| 41 | SEP-G | 0.5153
±0.0065 | This paper |
