GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling
Abstract
Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising performance for representation learning on graphs, which train models by maximizing agreement between original graphs and their augmented views (i.e., positive views). Unfortunately, these methods usually involve pre-defined augmentation strategies based on the knowledge of human experts. Moreover, these strategies may fail to generate challenging positive views to provide sufficient supervision signals. In this paper, we present a novel approach named graph pooling contrast (GPS) to address these issues. Motivated by the fact that graph pooling can adaptively coarsen the graph with the removal of redundancy, we rethink graph pooling and leverage it to automatically generate multi-scale positive views with varying emphasis on providing challenging positives and preserving semantics, i.e., strongly-augmented view and weakly-augmented view. Then, we incorporate both views into a joint contrastive learning framework with similarity learning and consistency learning, where our pooling module is adversarially trained with respect to the encoder for adversarial robustness. Experiments on twelve datasets on both graph classification and transfer learning tasks verify the superiority of the proposed method over its counterparts.
Benchmark Results
Tested on 4 datasets 12 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 63 | GCN | 0.9220
±0.0440 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery Curvature (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 158 | GraphSAGE | 0.9040
±0.0780 best reported | best at pub: Asynchronous Neural Networks for Learning in Graphs (2022) Difference within reported uncertainty; not counted as underperformance. |
| 159 | WL | 0.9040
±0.0570 best reported | best at pub: How Powerful are $K$-hop Message Passing Graph Neural Networks (NeurIPS 2022) |
| 178 | AD-GCL | 0.9028
±0.0401 best reported | best at pub: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Difference within reported uncertainty; not counted as underperformance. |
| 183 | GAT | 0.9010
±0.0580 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: The Expressive Power of Graph Neural Networks: A Survey (2023) Difference within reported uncertainty; not counted as underperformance. |
| 206 | GPS-TopK | 0.8990
±0.0070 | This paper |
| 233 | GPS-Cluster | 0.8950
±0.0120 | This paper |
| 257 | InfoGraph | 0.8930
±0.0514 best reported | best at pub: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 264 | GraphCLA | 0.8930
±0.0040 | This paper |
| 272 | SimGRACE | 0.8910
±0.0140 | prev best: SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentation (WWW 2022) Improvement within reported uncertainty; not highlighted. |
| 351 | JOAO | 0.8770
±0.0080 best reported | best at pub: Graph Self-Supervised Learning: A Survey (2021) best today: Learning Graph Augmentations to Learn Graph Representations (2022) Difference within reported uncertainty; not counted as underperformance. |
| 354 | GraphCL | 0.8766
±0.0103 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 403 | MLP | 0.8660
±0.0495 | |
| 407 | graph2vec | 0.8644
±0.0125 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 426 | SP | 0.8580
±0.0020 best reported | best at pub: Propagation Kernels (2014) Difference within reported uncertainty; not counted as underperformance. |
| 472 | Sub2Vec | 0.8447
±0.0037 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 506 | GK | 0.8350
±0.0060 best reported | best at pub: Supervised Contrastive Learning with Structure Inference for Graph Classification (2022) Difference within reported uncertainty; not counted as underperformance. |
| 718 | SAGE | 0.7490
±0.0870 | |
| 746 | Node2Vec | 0.7263
±0.1020 best reported | best at pub: Graph Contrastive Learning Automated (ICML 2021) best today: Model-Driven Graph Contrastive Learning (2025) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 best reported | best at pub: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 3 | GCN | 0.9727 best reported | best at pub: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 4 | GAT | 0.9623 best reported | best at pub: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 104 | GraphCL | 0.8250
±0.0013 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 131 | GraphSAGE | 0.8200
±0.0100 best reported | best at pub: Weisfeiler and Leman Go Infinite: Spectral and Combinatorial Pre-Colorings (TMLR 2022) |
| 141 | SimGRACE | 0.8180
±0.0015 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 249 | GPS-Cluster | 0.7950
±0.0040 | This paper |
| 260 | GPS-TopK | 0.7910
±0.0060 | This paper |
| 301 | JOAO | 0.7840
±0.0050 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 338 | InfoGraph | 0.7750
±0.0074 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 406 | graph2vec | 0.7540
±0.0120 best reported | best at pub: InfoGCL: Information-Aware Graph Contrastive Learning (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| 409 | AD-GCL | 0.7518
±0.0031 best reported | best at pub: Graph Contrastive Learning with Personalized Augmentation (2022) best today: GIMM: InfoMin-Max for Automated Graph Contrastive Learning (2023) |
| 421 | SP | 0.7450
±0.0030 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 452 | GraphCLA | 0.7300
±0.0060 | This paper |
| 519 | GK | 0.6600
±0.0010 | This paper |
| 557 | Sub2Vec | 0.5976
±0.0035 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) |
| 571 | Node2Vec | 0.5490
±0.0160 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 32 | GIN | 0.7880
±0.0410 best reported | best at pub: Permutation-Invariant graph partitioning: How graph neural networks capture structural interactions? (2023) Difference within reported uncertainty; not counted as underperformance. |
| 49 | GAT | 0.7800
±0.0300 best reported | best at pub: CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosis (2023) Difference within reported uncertainty; not counted as underperformance. |
| 67 | SAGE | 0.7726
±0.0228 | |
| 148 | GCN | 0.7600
±0.0320 best reported | best at pub: CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosis (2023) best today: Simplifying Graph Convolutional Networks with Redundancy-Free Neighbors (2025) Difference within reported uncertainty; not counted as underperformance. |
| 149 | MLP | 0.7600
±0.0320 | |
| 155 | GraphSAGE | 0.7590
±0.0320 best reported | best at pub: On Structural Expressive Power of Graph Transformers (KDD 2023) best today: Simplifying Graph Convolutional Networks with Redundancy-Free Neighbors (2025) Difference within reported uncertainty; not counted as underperformance. |
| 190 | WL | 0.7560
±0.0040 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 209 | SimGRACE | 0.7535
±0.0009 best reported | best at pub: SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentation (WWW 2022) best today: Adaptive Multi-view Graph Contrastive Learning via Fractional-order Neural Diffusion Networks (2025) Difference within reported uncertainty; not counted as underperformance. |
| 238 | GPS-TopK | 0.7510
±0.0040 | This paper |
| 265 | GraphCL | 0.7489
±0.0065 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 277 | GPS-Cluster | 0.7470
±0.0050 | This paper |
| 283 | JOAO | 0.7460
±0.0040 | prev best: Adversarial Graph Augmentation to Improve Graph Contrastive Learning (NeurIPS 2021) Improvement within reported uncertainty; not highlighted. |
| 291 | GraphCLA | 0.7450
±0.0060 | This paper |
| 294 | InfoGraph | 0.7444
±0.0040 best reported | best at pub: Adversarial Graph Augmentation to Improve Graph Contrastive Learning (NeurIPS 2021) best today: Adaptive Multi-view Graph Contrastive Learning via Fractional-order Neural Diffusion Networks (2025) Difference within reported uncertainty; not counted as underperformance. |
| 338 | AD-GCL | 0.7360
±0.0070 | prev best: Automated Data Augmentations for Graph Classification (ICLR 2022) |
| 350 | graph2vec | 0.7330
±0.0210 | This paper |
| 474 | Sub2Vec | 0.6731
±0.0050 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) |
| 514 | Node2Vec | 0.5750
±0.0360 | Improvement within reported uncertainty; not highlighted. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | SpeGCL | 0.5944
±0.0018 | |
| 2 | GIN | 0.5760
±0.0150 | This paper |
| 3 | LAMP-Soft | 0.5738
±0.0041 | |
| 9 | GPS-TopK | 0.5630
±0.0020 | This paper |
| 11 | GraphCL | 0.5600
±0.0030 | prev best: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Improvement within reported uncertainty; not highlighted. |
| 12 | SimGRACE | 0.5590
±0.0040 | This paper |
| 13 | GPS-Cluster | 0.5590
±0.0040 | This paper |
| 15 | JOAO | 0.5570
±0.0060 | This paper |
| 16 | AD-GCL | 0.5490
±0.0040 | prev best: GIMM: InfoMin-Max for Automated Graph Contrastive Learning (2023) |
| 19 | InfoGraph | 0.5350
±0.0100 | prev best: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Improvement within reported uncertainty; not highlighted. |
| 23 | graph2vec | 0.4790
±0.0030 | prev best: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Improvement within reported uncertainty; not highlighted. |
| 25 | WL | 0.4610
±0.0020 | prev best: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Improvement within reported uncertainty; not highlighted. |
| 26 | GraphSAGE | 0.4380
±0.0320 | This paper |
| 29 | GK | 0.4100
±0.0020 | This paper |
| 30 | SP | 0.3960
±0.0020 | This paper |
| 31 | Sub2Vec | 0.3670
±0.0040 | prev best: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Improvement within reported uncertainty; not highlighted. |
