Learning Graph Augmentations to Learn Graph Representations
Abstract
Devising augmentations for graph contrastive learning is challenging due to their irregular structure, drastic distribution shifts, and nonequivalent feature spaces across datasets. We introduce LG2AR, Learning Graph Augmentations to Learn Graph Representations, which is an end-to-end automatic graph augmentation framework that helps encoders learn generalizable representations on both node and graph levels. LG2AR consists of a probabilistic policy that learns a distribution over augmentations and a set of probabilistic augmentation heads that learn distributions over augmentation parameters. We show that LG2AR achieves state-of-the-art results on 18 out of 20 graph-level and node-level benchmarks compared to previous unsupervised models under both linear and semi-supervised evaluation protocols. The source code will be released here: https://github.com/kavehhassani/lg2ar
Benchmark Results
Tested on 6 datasets 13 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9703
±0.0019 | |
| 2 | GAT | 0.9260
±0.0040 | prev best: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification (2026) Improvement within reported uncertainty; not highlighted. |
| 3 | GAT+T | 0.9660
±0.0007 | |
| 7 | SAGE | 0.9643
±0.0027 | |
| 8 | GCN | 0.9632
±0.0008 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) |
| 95 | LG2AR + GRU | 0.9410
±0.0040 | This paper |
| 172 | BGRL | 0.9320
±0.0030 | prev best: Augmentation-Free Self-Supervised Learning on Graphs (AAAI 2021) Improvement within reported uncertainty; not highlighted. |
| 191 | GCA | 0.9320
±0.0060 best reported | best at pub: Calibrating and Improving Graph Contrastive Learning (TMLR 2021) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 203 | GRACE | 0.9280
±0.0050 | prev best: Augmentation-Free Self-Supervised Learning on Graphs (AAAI 2021) Improvement within reported uncertainty; not highlighted. |
| 206 | MVGRL | 0.9310
±0.0040 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 213 | DGI | 0.9309
±0.0008 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) |
| 270 | LG2AR + DeepSet | 0.9260
±0.0050 | This paper |
| 300 | LG2AR + Random | 0.9240
±0.0060 | This paper |
| 317 | VGAE | 0.9224 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) Difference within reported uncertainty; not counted as underperformance. |
| 328 | GIN | 0.9211
±0.0032 best reported | best today: Union Subgraph Neural Networks (AAAI 2023) |
| 352 | GAE | 0.9185
±0.0006 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) best today: Graph Masked Autoencoders with Transformers (2022) |
| 390 | MLP | 0.9128
±0.0063 | |
| 408 | GMI | 0.9070
±0.0020 | prev best: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) Improvement within reported uncertainty; not highlighted. |
| 443 | DeepWalk + feat. | 0.9010
±0.0010 | This paper |
| 444 | DeepWalk | 0.9005
±0.0008 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) |
| 457 | Node2Vec | 0.8970
±0.0010 | prev best: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) Improvement within reported uncertainty; not highlighted. |
| 531 | Raw features | 0.7999
±0.0090 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Model-Driven Graph Contrastive Learning (2025) |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GrokFormer | 0.9831
±0.0018 | |
| 2 | PolyFormer | 0.9808
±0.0027 | |
| 3 | SGFormer | 0.9796
±0.0081 | |
| 6 | GAT | 0.9782
±0.0028 best reported | best at pub: SelfGNN: Self-supervised Graph Neural Networks without explicit negative sampling (WWW 2021) best today: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) |
| 9 | GCN | 0.9774
±0.0035 best reported | best at pub: SelfGNN: Self-supervised Graph Neural Networks without explicit negative sampling (WWW 2021) best today: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) |
| 17 | SAGE | 0.9739
±0.0018 | |
| 58 | MLP | 0.9597
±0.0007 | |
| 63 | GCA | 0.9590
±0.0020 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) best today: Unifying Graph Contrastive Learning with Flexible Contextual Scopes (2022) |
| 69 | BGRL | 0.9570
±0.0010 | prev best: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) Improvement within reported uncertainty; not highlighted. |
| 88 | LG2AR + GRU | 0.9570
±0.0020 | This paper |
| 120 | LG2AR + DeepSet | 0.9550
±0.0010 | This paper |
| 125 | MVGRL | 0.9544
±0.0027 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption (2023) Difference within reported uncertainty; not counted as underperformance. |
| 128 | LG2AR + Random | 0.9540
±0.0010 | This paper |
| 137 | GIN | 0.9530
±0.0010 best reported | best today: Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision (NeurIPS 2024) Difference within reported uncertainty; not counted as underperformance. |
| 146 | GAE | 0.9520
±0.0010 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 163 | DeepWalk | 0.9490 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) |
| 162 | DeepWalk + feat. | 0.9490
±0.0010 | This paper |
| 167 | DGI | 0.9489
±0.0009 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 174 | VGAE | 0.9452 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) |
| 182 | Raw features | 0.9360 | prev best: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Model-Driven Graph Contrastive Learning (2025) |
| 268 | Node2Vec | 0.9120 | prev best: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) Improvement within reported uncertainty; not highlighted. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GCN | 0.9302
±0.0011 best reported | best today: Augmentation-Free Graph Contrastive Learning with Performance Guarantee (2022) |
| 2 | RSE + RGCN (70b) | 0.8852
±0.0019 | |
| 3 | LEMP+T | 0.8825 | |
| 9 | SAGE | 0.8771 | |
| 31 | GAT | 0.8533 best reported | |
| 54 | GIN | 0.8303
±0.0021 best reported | |
| 94 | GRACE | 0.8014
±0.0048 best reported | best at pub: Large-Scale Representation Learning on Graphs via Bootstrapping (ICLR 2021) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) Difference within reported uncertainty; not counted as underperformance. |
| 100 | BGRL | 0.8000
±0.0010 | prev best: Large-Scale Representation Learning on Graphs via Bootstrapping (ICLR 2021) Improvement within reported uncertainty; not highlighted. |
| 151 | DGI | 0.7540
±0.0010 | prev best: Graph Barlow Twins: A self-supervised representation learning framework for graphs (2021) Improvement within reported uncertainty; not highlighted. |
| 162 | GCA | 0.7840
±0.0010 | prev best: Graph Barlow Twins: A self-supervised representation learning framework for graphs (2021) Improvement within reported uncertainty; not highlighted. |
| 181 | GAE | 0.7020 | prev best: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) best today: Negative-Free Self-Supervised Gaussian Embedding of Graphs (2024) |
| 180 | VGAE | 0.7787
±0.0053 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) best today: Negative-Free Self-Supervised Gaussian Embedding of Graphs (2024) |
| 185 | LG2AR + GRU | 0.7780
±0.0050 | This paper |
| 190 | MVGRL | 0.7757
±0.0046 best reported | best at pub: Graph Barlow Twins: A self-supervised representation learning framework for graphs (2021) best today: Negative-Free Self-Supervised Gaussian Embedding of Graphs (2024) Difference within reported uncertainty; not counted as underperformance. |
| 198 | DeepWalk | 0.7721 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) |
| 200 | DeepWalk + feat. | 0.7721
±0.0300 best reported | best at pub: Graph Barlow Twins: A self-supervised representation learning framework for graphs (2021) Difference within reported uncertainty; not counted as underperformance. |
| 217 | LG2AR + DeepSet | 0.7620
±0.0090 | This paper |
| 218 | LG2AR + Random | 0.7620
±0.0070 | This paper |
| 234 | GMI | 0.7490
±0.0010 | prev best: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) Improvement within reported uncertainty; not highlighted. |
| 237 | MLP | 0.7469
±0.0085 | |
| 256 | Raw features | 0.7198 | This paper |
| 258 | Node2Vec | 0.7180
±0.0010 | prev best: Augmentation-Free Self-Supervised Learning on Graphs (AAAI 2021) Improvement within reported uncertainty; not highlighted. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | DoG | 0.9690
±0.0030 | |
| 2 | GWN-fa | 0.9667
±0.0026 | |
| 3 | GWN-sym | 0.9666
±0.0026 | |
| 6 | GraphSAGE | 0.9593
±0.0025 | |
| 12 | GCN | 0.9514
±0.0025 best reported | best at pub: Unifying Graph Convolutional Neural Networks and Label Propagation (2020) best today: Graph Wave Networks (WWW 2025) |
| 21 | GAT | 0.9437
±0.0028 best reported | best at pub: Unifying Graph Convolutional Neural Networks and Label Propagation (2020) best today: Graph Wave Networks (WWW 2025) |
| 39 | LG2AR + GRU | 0.9360
±0.0030 | This paper |
| 43 | DGI | 0.9350
±0.0030 best reported | best at pub: Towards Graph Self-Supervised Learning with Contrastive Adjusted Zooming (2021) best today: PyG-SSL: A Graph Self-Supervised Learning Toolkit (2024) |
| 51 | GCA | 0.9332
±0.0012 best reported | |
| 53 | BGRL | 0.9331
±0.0013 best reported | best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) Difference within reported uncertainty; not counted as underperformance. |
| 69 | GRACE | 0.9301
±0.0003 best reported | best at pub: Towards Graph Self-Supervised Learning with Contrastive Adjusted Zooming (2021) best today: A Fused Gromov-Wasserstein Approach to Subgraph Contrastive Learning (TMLR 2025) |
| 88 | MLP | 0.9280
±0.0020 | |
| 105 | LG2AR + DeepSet | 0.9240
±0.0030 | This paper |
| 108 | LG2AR + Random | 0.9230
±0.0020 | This paper |
| 117 | VGAE | 0.9211
±0.0009 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Rethinking Graph Contrastive Learning through Relative Similarity Preservation (IJCAI 2025) Difference within reported uncertainty; not counted as underperformance. |
| 116 | MVGRL | 0.9211
±0.0012 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) Difference within reported uncertainty; not counted as underperformance. |
| 138 | GIN | 0.9140
±0.0020 | This paper |
| 158 | Raw features | 0.9040 | prev best: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) |
| 163 | GAE | 0.9005
±0.0035 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption (2023) Difference within reported uncertainty; not counted as underperformance. |
| 176 | DeepWalk + feat. | 0.8770 | This paper |
| 184 | Node2Vec | 0.8510 | prev best: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) Improvement within reported uncertainty; not highlighted. |
| 188 | DeepWalk | 0.8461
±0.0022 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Negative-Free Self-Supervised Gaussian Embedding of Graphs (2024) Difference within reported uncertainty; not counted as underperformance. |
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 63 | GCN | 0.9220
±0.0440 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery Curvature (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 159 | WL | 0.9040
±0.0570 best reported | best at pub: Understanding Isomorphism Bias in Graph Data Sets (2019) best today: How Powerful are $K$-hop Message Passing Graph Neural Networks (NeurIPS 2022) |
| 158 | GraphSAGE | 0.9040
±0.0780 | |
| 183 | GAT | 0.9010
±0.0580 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: The Expressive Power of Graph Neural Networks: A Survey (2023) Difference within reported uncertainty; not counted as underperformance. |
| 195 | LG2AR + GRU | 0.9000
±0.0060 | This paper |
| 215 | ADGCL | 0.8970
±0.0100 | This paper |
| 257 | InfoGraph | 0.8930
±0.0514 best reported | best at pub: Graph Contrastive Learning Automated (ICML 2021) best today: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 283 | LG2AR + DeepSet | 0.8890
±0.0060 | This paper |
| 305 | LG2AR + Random | 0.8860
±0.0050 | This paper |
| 332 | MLG | 0.8794
±0.0161 best reported | best at pub: The Multiscale Laplacian Graph Kernel (NeurIPS 2016) Difference within reported uncertainty; not counted as underperformance. |
| 351 | JOAO | 0.8770
±0.0080 | This paper |
| 354 | GraphCL | 0.8766
±0.0103 best reported | best at pub: Graph Contrastive Learning Automated (ICML 2021) best today: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 365 | DGK | 0.8744
±0.0272 best reported | best at pub: Provably Powerful Graph Networks (NeurIPS 2019) best today: Model-Driven Graph Contrastive Learning (2025) Difference within reported uncertainty; not counted as underperformance. |
| 403 | MLP | 0.8660
±0.0495 | |
| 407 | graph2vec | 0.8644
±0.0125 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) best today: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 426 | SP | 0.8580
±0.0020 best reported | best at pub: Propagation Kernels (2014) Difference within reported uncertainty; not counted as underperformance. |
| 472 | Sub2Vec | 0.8447
±0.0037 best reported | best at pub: Learning Graph Representation by Aggregating Subgraphs via Mutual Information Maximization (2021) best today: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 500 | random walk | 0.8370
±0.0150 | This paper |
| 506 | GK | 0.8350
±0.0060 best reported | best at pub: Contrastive Multi-View Representation Learning on Graphs (ICML 2020) best today: Supervised Contrastive Learning with Structure Inference for Graph Classification (2022) Difference within reported uncertainty; not counted as underperformance. |
| 746 | Node2Vec | 0.7263
±0.1020 best reported | best at pub: Graph Contrastive Learning Automated (ICML 2021) best today: Model-Driven Graph Contrastive Learning (2025) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 23 | GCN | 0.8260
±0.0220 | |
| 146 | InfoGraph | 0.7940 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) |
| 151 | MLP | 0.7920
±0.0240 | |
| 183 | LG2AR + GRU | 0.7780
±0.0020 | This paper |
| 184 | LG2AR + DeepSet | 0.7780
±0.0020 | This paper |
| 190 | LG2AR + Random | 0.7760
±0.0020 | This paper |
