LAC: Graph Contrastive Learning with Learnable Augmentation in Continuous Space
Abstract
Graph Contrastive Learning frameworks have demonstrated success in generating high-quality node representations. The existing research on efficient data augmentation methods and ideal pretext tasks for graph contrastive learning remains limited, resulting in suboptimal node representation in the unsupervised setting. In this paper, we introduce LAC, a graph contrastive learning framework with learnable data augmentation in an orthogonal continuous space. To capture the representative information in the graph data during augmentation, we introduce a continuous view augmenter, that applies both a masked topology augmentation module and a cross-channel feature augmentation module to adaptively augment the topological information and the feature information within an orthogonal continuous space, respectively. The orthogonal nature of continuous space ensures that the augmentation process avoids dimension collapse. To enhance the effectiveness of pretext tasks, we propose an information-theoretic principle named InfoBal and introduce corresponding pretext tasks. These tasks enable the continuous view augmenter to maintain consistency in the representative information across views while maximizing diversity between views, and allow the encoder to fully utilize the representative information in the unsupervised setting. Our experimental results show that LAC significantly outperforms the state-of-the-art frameworks.
Benchmark Results
Tested on 3 datasets 17 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 18 | GCN | 0.9296
±0.0015 | |
| 136 | CCA-SSG | 0.8840
±0.0060 best reported | best at pub: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 144 | BGRL | 0.8830
±0.0010 best reported | best at pub: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 194 | GRACE | 0.8730
±0.0010 best reported | best at pub: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 196 | MVGRL | 0.8725
±0.0012 best reported | |
| 204 | DGI | 0.8708
±0.0017 best reported | |
| 208 | COSTA | 0.8698
±0.0033 best reported | |
| 210 | MLP | 0.8690
±0.0074 | |
| 229 | LAC | 0.8605
±0.0021 | This paper |
| 244 | ADGCL | 0.8545
±0.0033 | This paper |
| 243 | GCL-SPAN | 0.8545
±0.0016 | prev best: Spectral-Aware Augmentation for Enhanced Graph Representation Learning (2023) |
| 251 | Node2Vec | 0.8520
±0.0002 best reported | |
| 255 | GCA | 0.8512
±0.0023 | prev best: Graph Masked Autoencoders with Transformers (2022) |
| 271 | AutoGCL | 0.8427
±0.0052 | This paper |
| 284 | RawFeat | 0.8384
±0.0010 | This paper |
| 299 | VGAE | 0.8307
±0.0029 | prev best: Decoupled Self-supervised Learning for Non-Homophilou Graphs (2022) |
| 304 | GAE | 0.8294
±0.0031 | prev best: Multi-View Graph Representation Learning Beyond Homophily (2023) Improvement within reported uncertainty; not highlighted. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9703
±0.0019 | |
| 2 | GAT | 0.9669
±0.0014 | |
| 3 | GAT+T | 0.9660
±0.0007 | |
| 7 | SAGE | 0.9643
±0.0027 | |
| 120 | LAC | 0.9375
±0.0043 | This paper |
| 172 | BGRL | 0.9337
±0.0021 best reported | best at pub: Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning (AAAI 2022) Difference within reported uncertainty; not counted as underperformance. |
| 176 | MC-DCD | 0.9331
±0.0013 | This paper |
| 186 | CCA-SSG | 0.9325
±0.0021 best reported | best at pub: Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning (AAAI 2022) Difference within reported uncertainty; not counted as underperformance. |
| 191 | GCA | 0.9320
±0.0060 best reported | best at pub: Unifying Graph Contrastive Learning with Flexible Contextual Scopes (2022) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 203 | GRACE | 0.9313
±0.0017 best reported | best at pub: Learning Graph Augmentations to Learn Graph Representations (2022) best today: Learn Beneficial Noise as Graph Augmentation (ICML 2025) |
| 206 | MVGRL | 0.9310
±0.0040 best reported | best at pub: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 213 | DGI | 0.9309
±0.0008 best reported | |
| 263 | COSTA | 0.9267
±0.0016 best reported | best at pub: Noise-Resilient Unsupervised Graph Representation Learning via Multi-Hop Feature Quality Estimation (2024) Difference within reported uncertainty; not counted as underperformance. |
| 275 | GCL-SPAN | 0.9258
±0.0017 | prev best: Spectral-Aware Augmentation for Enhanced Graph Representation Learning (2023) |
| 316 | AutoGCL | 0.9225
±0.0030 | prev best: GIMM: InfoMin-Max for Automated Graph Contrastive Learning (2023) Improvement within reported uncertainty; not highlighted. |
| 317 | VGAE | 0.9224 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) Difference within reported uncertainty; not counted as underperformance. |
| 352 | GAE | 0.9185
±0.0006 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) |
| 376 | ADGCL | 0.9145
±0.0012 | This paper |
| 384 | JOAO-v2 | 0.9139
±0.0025 | prev best: GIMM: InfoMin-Max for Automated Graph Contrastive Learning (2023) Improvement within reported uncertainty; not highlighted. |
| 390 | MLP | 0.9128
±0.0063 | |
| 457 | Node2Vec | 0.8970
±0.0010 best reported | best at pub: Learning Graph Augmentations to Learn Graph Representations (2022) best today: Multiplex Graph Contrastive Learning with Soft Negatives (2024) Difference within reported uncertainty; not counted as underperformance. |
| 522 | RawFeat | 0.8352
±0.0031 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9461
±0.0017 | |
| 2 | GCN | 0.9412
±0.0008 | |
| 3 | GAT | 0.9398
±0.0022 | |
| 8 | SAGE | 0.9351
±0.0006 | |
| 70 | LAC | 0.9055
±0.0016 | This paper |
| 79 | BGRL | 0.9034
±0.0019 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) |
| 105 | GCL-SPAN | 0.8996
±0.0013 | This paper |
| 139 | GRACE | 0.8953
±0.0035 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) |
| 159 | CCA-SSG | 0.8896
±0.0013 best reported | best at pub: Graph Soft-Contrastive Learning via Neighborhood Ranking (2022) best today: Str-GCL: Structural Commonsense Driven Graph Contrastive Learning (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 160 | GCA | 0.8894
±0.0015 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) |
| 171 | MC-DCD | 0.8878
±0.0025 | This paper |
| 179 | MVGRL | 0.8861
±0.0064 best reported | best at pub: Training MLPs on Graphs without Supervision (2024) |
| 192 | COSTA | 0.8837
±0.0022 best reported | best at pub: HomoGCL: Rethinking Homophily in Graph Contrastive Learning (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 210 | DGI | 0.8798
±0.0081 best reported | best at pub: Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learning (2024) |
| 246 | VGAE | 0.8721
±0.0026 best reported | best at pub: HC-GAE: The Hierarchical Cluster-based Graph Auto-Encoder for Graph Representation Learning (NeurIPS 2024) |
| 248 | AutoGCL | 0.8711
±0.0084 | This paper |
| 261 | JOAO-v2 | 0.8673
±0.0044 | This paper |
| 264 | GAE | 0.8666
±0.0007 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) |
| 287 | ADGCL | 0.8603
±0.0021 | This paper |
| 320 | MLP | 0.8463 | |
| 330 | Node2Vec | 0.8440
±0.0010 best reported | best at pub: Unifying Graph Contrastive Learning with Flexible Contextual Scopes (2022) best today: Multiplex Graph Contrastive Learning with Soft Negatives (2024) Difference within reported uncertainty; not counted as underperformance. |
| 438 | RawFeat | 0.7853 | This paper |
