SPGCL: Simple yet Powerful Graph Contrastive Learning via SVD-Guided Structural Perturbation
Abstract
Graph Neural Networks (GNNs) are highly sensitive to structural noise, including spurious or missing edges caused by adversarial attacks or non-adversarial imperfections. Existing graph contrastive learning methods typically rely on either random perturbations (e.g., edge dropping) to ensure view diversity, or purely spectral augmentations (e.g., SVD) to preserve global structural priors. However, random perturbations are structure-agnostic and may inadvertently remove critical edges, while purely SVD-based views tend to be dense and lack sufficient diversity. More fundamentally, despite their complementary strengths, there exists no straightforward way to integrate these two fundamentally different paradigms: one operates on discrete edge removal while the other relies on continuous matrix factorization. To bridge this non-trivial gap, we propose SPGCL, a simple yet powerful framework for robust graph contrastive learning via SVD-guided structural perturbation. Our key insight lies in leveraging a recently developed SVD-based perturbation method, which generalizes the classical structural perturbation theory from symmetric to arbitrary graphs. We creatively adapt this technique to contrastive learning by designing a concise two-stage perturbation strategy: first, a lightweight stochastic edge removal injects necessary diversity; second, truncated SVD is applied to derive a structure-aware scoring matrix, followed by sparse top-$P$ edge recovery. This synergistic integration delivers three key advantages: (1) Robustness to accidental deletion - important edges removed in the first stage can be recovered by SVD-guided scoring, mitigating harmful effects while preserving diversity. (2) Enrichment with missing links - the SVD-based scoring can introduce new, semantically meaningful edges absent in the original graph, creating a more informative contrastive view. (3) Controllable structural discrepancy – by balancing edge removal and recovery rates, we explicitly control the edge count between views, ensuring that the contrastive signal stems from semantic structural differences rather than trivial edge-number gaps. Furthermore, we incorporate a contrastive fusion module regularized by a global similarity constraint to align node embeddings across views. Extensive experiments on ten benchmark datasets demonstrate that SPGCL consistently improves the robustness and accuracy of base GNNs, outperforming state-of-the-art graph contrastive learning and structure learning methods, thereby validating its simplicity, effectiveness, and innovative integration of previously disparate paradigms.
Benchmark Results
Tested on 6 datasets 37 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 best reported | best at pub: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 39 | SAGE | 0.8911
±0.0012 | |
| 43 | DropEdge | 0.8900 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 44 | GAT | 0.8897
±0.0014 best reported | |
| 141 | GraphSAGE | 0.8708
±0.0085 best reported | best at pub: Large Language Model Meets Graph Neural Network in Knowledge Distillation (AAAI 2024) |
| 207 | Geom-GCN | 0.8540
±0.0040 best reported | best at pub: The Expressive Power of Graph Neural Networks: A Survey (2023) |
| 223 | SGC | 0.8509
±0.0648 best reported | best at pub: LOGIN: A Large Language Model Consulted Graph Neural Network Training Framework (2024) Difference within reported uncertainty; not counted as underperformance. |
| 309 | LDS | 0.8390
±0.0060 best reported | best at pub: Discovering Data Geometry: Energy-Driven Neural Diffusion (ICLR 2023) best today: Transformers from Diffusion: A Unified Framework for Neural Message Passing (JMLR 2024) |
| 418 | SPGCL | 0.8310 | This paper |
| 584 | Pro-GNN | 0.8130 | prev best: Towards Self-Explainable Graph Neural Network (2021) |
| 724 | MLP | 0.7768 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 24 | DropEdge | 0.8130 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 35 | GAT | 0.8080
±0.0026 best reported | best at pub: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 44 | GCN | 0.8033
±0.0088 best reported | best at pub: NTFormer: A Composite Node Tokenized Graph Transformer for Node Classification (2024) |
| 61 | GraphSAGE | 0.7923
±0.0053 best reported | best at pub: Gophormer: Ego-Graph Transformer for Node Classification (2021) |
| 88 | Geom-GCN | 0.7799
±0.0115 best reported | best at pub: Feature Transportation Improves Graph Neural Networks (AAAI 2023) |
| 96 | SGC | 0.7765
±0.0012 best reported | |
| 186 | LDS | 0.7480
±0.0030 best reported | best at pub: Discovering Data Geometry: Energy-Driven Neural Diffusion (ICLR 2023) |
| 212 | SPGCL | 0.7430 | This paper |
| 259 | SAGE | 0.7361
±0.0190 | |
| 294 | Pro-GNN | 0.7330
±0.0070 best reported | best at pub: Towards Self-Explainable Graph Neural Network (2021) |
| 350 | MLP | 0.7289
±0.0010 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9703
±0.0019 | |
| 2 | GAT | 0.9669
±0.0014 best reported | |
| 3 | GAT+T | 0.9660
±0.0007 | |
| 7 | SAGE | 0.9643
±0.0027 | |
| 8 | GCN | 0.9632
±0.0008 best reported | |
| 50 | SGC | 0.9511
±0.0009 best reported | |
| 56 | GraphSAGE | 0.9508
±0.0026 best reported | best at pub: A Quasi-Wasserstein Loss for Learning Graph Neural Networks (WWW 2023) |
| 306 | Geom-GCN | 0.9235
±0.0131 best reported | best today: Graph Navier–Stokes Networks (2026) |
| 324 | DropEdge | 0.9221 best reported | best at pub: NCGNN: Node-Level Capsule Graph Neural Network for Semisupervised Classification (2020) |
| 390 | MLP | 0.9128
±0.0063 | |
| 406 | SPGCL | 0.9084 | This paper |
| 558 | Pro-GNN | 0.7059 | This paper |
| 565 | LDS | 0.5261 | This paper |
Heterophilic Graphs
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | DiGGR | 0.4535
±0.0353 | |
| 2 | TRIGON | 0.4402
±0.0028 | |
| 3 | DoG | 0.4320
±0.0120 | |
| 42 | MLP | 0.4026
±0.0108 | |
| 68 | GraphSAGE | 0.3899
±0.0085 best reported | best at pub: A Quasi-Wasserstein Loss for Learning Graph Neural Networks (WWW 2023) |
| 87 | Geom-GCN | 0.3810 best reported | best at pub: Beyond Low-frequency Information in Graph Convolutional Networks (AAAI 2021) |
| 135 | GCN | 0.3690 best reported | best at pub: Beyond Low-frequency Information in Graph Convolutional Networks (AAAI 2021) |
| 144 | DropEdge | 0.3680
±0.0290 best reported | |
| 182 | GAT | 0.3605
±0.0035 best reported | best at pub: Hierarchical Graph Transformer with Adaptive Node Sampling (NeurIPS 2022) |
| 237 | SGC | 0.3490
±0.0070 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 266 | GIN | 0.3410
±0.0030 | |
| 326 | LDS | 0.3105
±0.0131 best reported | best at pub: Graph Structure Refinement with Energy-based Contrastive Learning (AAAI 2024) |
| 328 | SPGCL | 0.3092 | This paper |
| 330 | Pro-GNN | 0.3083 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | Hetero-S (GAT 8-layer) | 0.8693 | |
| 2 | Dir-GNN+CNA | 0.8586
±0.0180 | |
| 3 | GAT | 0.8560 best reported | best at pub: The Heterophilic Snowflake Hypothesis: Training and Empowering GNNs for Heterophilic Graphs (KDD 2024) |
| 52 | GCN | 0.7033 best reported | best at pub: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 76 | SGC | 0.6710
±0.0290 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 108 | SAGE | 0.6340
±0.0300 | |
| 115 | GraphSAGE | 0.6215
±0.0042 best reported | best at pub: Hierarchical Graph Transformer with Adaptive Node Sampling (NeurIPS 2022) |
| 118 | SPGCL | 0.6184 | This paper |
| 124 | Geom-GCN | 0.6090 best reported | best at pub: Non-Local Graph Neural Networks (2020) |
| 160 | Pro-GNN | 0.5620 | This paper |
| 169 | MLP | 0.5429 | |
| 238 | DropEdge | 0.4310
±0.0050 best reported | |
| 266 | LDS | 0.3675 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | IBG-NN | 0.7763
±0.0179 | |
| 2 | Dir-GNN+CNA | 0.7747
±0.0128 | |
| 3 | DHGNN | 0.7684
±0.0161 | |
| 46 | GCN | 0.6067 best reported | best at pub: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 67 | GAT | 0.5630
±0.0220 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 81 | SGC | 0.5230
±0.0230 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 120 | SAGE | 0.4460
±0.0130 | |
| 128 | GraphSAGE | 0.4378
±0.0190 best reported | |
| 172 | MLP | 0.3930
±0.0079 | |
| 178 | SPGCL | 0.3862 | This paper |
| 179 | Geom-GCN | 0.3832
±0.0092 best reported | best at pub: Feature Transportation Improves Graph Neural Networks (AAAI 2023) |
| 221 | Pro-GNN | 0.3497 | This paper |
| 250 | LDS | 0.2787 | This paper |
| 262 | DropEdge | 0.2527 | This paper |
