Fractal Graph Contrastive Learning
Abstract
Graph Contrastive Learning (GCL) relies on semantically consistent graph augmentations, but common local perturbations provide limited control over global structural consistency, motivating a more principled global augmentation strategy. We therefore propose Fractal Graph Contrastive Learning (FractalGCL), a theory-motivated framework that constructs a renormalisation-based augmented graph and introduces a fractal-dimension-aware contrastive loss that penalises unreliable positive views and reweights negative-pair repulsion by finite-scale box-counting discrepancies. However, computing these discrepancies introduces substantial overhead, so we derive and justify a Gaussian surrogate that avoids repeated box-counting on renormalised graphs, yielding about a $61\ Experiments show that FractalGCL serves as an effective frozen-pretraining tool on MalNet-Tiny, achieves strong performance on the standard TUDataset benchmarks, and outperforms the next-best method on real-world urban traffic tasks by $4.51$ percentage points in average accuracy. Code is available at.
Benchmark Results
Tested on 4 datasets 8 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 | |
| 79 | FractalGCL | 0.9171
±0.0023 | This paper |
| 222 | JOAOv2 | 0.8967
±0.0524 best reported | best at pub: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Difference within reported uncertainty; not counted as underperformance. |
| 227 | MGCL | 0.8955
±0.0108 | This paper |
| 228 | GAE | 0.8950
±0.0150 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 229 | DRGCL | 0.8950
±0.0060 | This paper |
| 257 | InfoGraph | 0.8930
±0.0514 best reported | best at pub: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 272 | SimGRACE | 0.8910
±0.0140 best reported | best at pub: GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling (2024) Difference within reported uncertainty; not counted as underperformance. |
| 311 | GradGCL | 0.8846
±0.0098 | This paper |
| 351 | JOAO | 0.8770
±0.0080 best reported | best at pub: Graph Self-Supervised Learning: A Survey (2021) best today: Learning Graph Augmentations to Learn Graph Representations (2022) Difference within reported uncertainty; not counted as underperformance. |
| 354 | GraphCL | 0.8766
±0.0103 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 355 | RGCL | 0.8766
±0.0101 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 407 | graph2vec | 0.8644
±0.0125 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 517 | DGI | 0.8320
±0.0130 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 753 | ContextPred | 0.7175
±0.0734 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 | |
| 3 | GCN | 0.9727 | |
| 104 | GraphCL | 0.8250
±0.0013 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 141 | SimGRACE | 0.8180
±0.0015 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 146 | JOAOv2 | 0.8170
±0.0026 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 192 | FractalGCL | 0.8050
±0.0016 | This paper |
| 236 | GAE | 0.7978
±0.0017 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 239 | GradGCL | 0.7972
±0.0053 | This paper |
| 277 | DRGCL | 0.7870
±0.0040 | This paper |
| 283 | MGCL | 0.7866
±0.0034 | This paper |
| 301 | JOAO | 0.7840
±0.0050 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 315 | RGCL | 0.7814
±0.0108 | This paper |
| 338 | InfoGraph | 0.7750
±0.0074 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 388 | DGI | 0.7620
±0.0180 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 406 | graph2vec | 0.7540
±0.0120 best reported | best at pub: InfoGCL: Information-Aware Graph Contrastive Learning (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| 450 | ContextPred | 0.7300
±0.0030 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 32 | GIN | 0.7880
±0.0410 | |
| 149 | MLP | 0.7600
±0.0320 | |
| 162 | FractalGCL | 0.7585
±0.0040 | This paper |
| 209 | SimGRACE | 0.7535
±0.0009 best reported | |
| 226 | DRGCL | 0.7520
±0.0060 | This paper |
| 242 | RGCL | 0.7503
±0.0043 | This paper |
| 265 | GraphCL | 0.7489
±0.0065 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 266 | GradGCL | 0.7489
±0.0039 | This paper |
| 269 | MGCL | 0.7485
±0.0071 | This paper |
| 283 | JOAO | 0.7460
±0.0040 best reported | best at pub: GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling (2024) best today: Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 294 | InfoGraph | 0.7444
±0.0031 | This paper |
| 309 | JOAOv2 | 0.7407
±0.0110 | This paper |
| 350 | graph2vec | 0.7330
±0.0205 | This paper |
| 400 | DGI | 0.7227
±0.0040 | This paper |
| 451 | GAE | 0.7051
±0.0017 | This paper |
| 455 | ContextPred | 0.7023
±0.0063 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GC-GNN (GCN) | 0.9210
±0.0810 | |
| 2 | SUGAR | 0.8403
±0.0133 | |
| 3 | Ortho-g-U-Nets | 0.8387 | |
| 15 | SAGE | 0.8088
±0.0233 | |
| 22 | FractalGCL | 0.8014
±0.0012 | This paper |
| 47 | GradGCL | 0.7895
±0.0047 | This paper |
| 49 | MGCL | 0.7888
±0.0038 | This paper |
| 50 | RGCL | 0.7886
±0.0048 | This paper |
| 58 | GraphCL | 0.7862
±0.0040 | This paper |
| 65 | DRGCL | 0.7840
±0.0070 | This paper |
| 93 | SimGRACE | 0.7744
±0.0111 | This paper |
| 94 | JOAOv2 | 0.7740
±0.0115 | This paper |
| 98 | JOAO | 0.7732
±0.0054 | This paper |
| 124 | DGI | 0.7578
±0.0034 | This paper |
| 141 | ContextPred | 0.7466
±0.0051 | This paper |
| 145 | GAE | 0.7454
±0.0068 | This paper |
| 148 | InfoGraph | 0.7424
±0.0086 best reported | best at pub: Contrastive Self-supervised Learning for Graph Classification (AAAI 2020) Difference within reported uncertainty; not counted as underperformance. |
| 169 | graph2vec | 0.7032
±0.0232 | This paper |
