Fractal Graph Contrastive Learning

Nero Li, Xuehao Zhai, Zhichao Shi, B. Shi, Xuhui Jiang

Main figure for Fractal Graph Contrastive Learning

Abstract

Graph Contrastive Learning (GCL) relies on semantically consistent graph augmentations, but common local perturbations provide limited control over global structural consistency, motivating a more principled global augmentation strategy. We therefore propose Fractal Graph Contrastive Learning (FractalGCL), a theory-motivated framework that constructs a renormalisation-based augmented graph and introduces a fractal-dimension-aware contrastive loss that penalises unreliable positive views and reweights negative-pair repulsion by finite-scale box-counting discrepancies. However, computing these discrepancies introduces substantial overhead, so we derive and justify a Gaussian surrogate that avoids repeated box-counting on renormalised graphs, yielding about a $61\ Experiments show that FractalGCL serves as an effective frozen-pretraining tool on MalNet-Tiny, achieves strong performance on the standard TUDataset benchmarks, and outperforms the next-best method on real-world urban traffic tasks by $4.51$ percentage points in average accuracy. Code is available at.

Proposed method: FractalGCL

Benchmark Results

Tested on 4 datasets 8 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
79
FractalGCL
0.9171 ±0.0023
This paper
222
JOAOv2
actual #222 vs paper #353 131 places worse
0.8967 ±0.0524
best reported
actual #222 vs paper #353 131 places worse
paper 0.8767 ±0.0079

Difference within reported uncertainty; not counted as underperformance.

paper 0.8767 ±0.0079 Δ at pub 0.0200
227
MGCL
0.8955 ±0.0108
This paper
228
GAE
actual #228 vs paper #742 514 places worse
0.8950 ±0.0150
best reported
actual #228 vs paper #742 514 places worse
paper 0.7287 ±0.0684
paper 0.7287 ±0.0684 Δ at pub 0.1663
229
DRGCL
0.8950 ±0.0060
This paper
257
InfoGraph
actual #257 vs paper #272 15 places worse
0.8930 ±0.0514
best reported
actual #257 vs paper #272 15 places worse
paper 0.8901 ±0.0113

Difference within reported uncertainty; not counted as underperformance.

paper 0.8901 ±0.0113 Δ at pub 0.0029
272
SimGRACE
actual #272 vs paper #272
0.8910 ±0.0140
best reported
actual #272 vs paper #272
paper 0.8901 ±0.0131

Difference within reported uncertainty; not counted as underperformance.

paper 0.8901 ±0.0131 Δ at pub 0.0009
311
GradGCL
0.8846 ±0.0098
This paper
351
JOAO
actual #351 vs paper #370 19 places worse
0.8770 ±0.0080
best reported
actual #351 vs paper #370 19 places worse
paper 0.8735 ±0.0102

Difference within reported uncertainty; not counted as underperformance.

paper 0.8735 ±0.0102 Δ at pub 0.0035 Δ today 0.0035
354
GraphCL
actual #354 vs paper #396 42 places worse
0.8766 ±0.0103
best reported
actual #354 vs paper #396 42 places worse
paper 0.8680 ±0.0134

Difference within reported uncertainty; not counted as underperformance.

paper 0.8680 ±0.0134 Δ at pub 0.0086
355
RGCL
0.8766 ±0.0101
This paper
403
MLP
0.8660 ±0.0495
407
graph2vec
actual #407 vs paper #517 110 places worse
0.8644 ±0.0125
best reported
actual #407 vs paper #517 110 places worse
paper 0.8315 ±0.0925

Difference within reported uncertainty; not counted as underperformance.

paper 0.8315 ±0.0925 Δ at pub 0.0329
517
DGI
actual #517 vs paper #772 255 places worse
0.8320 ±0.0130
best reported
actual #517 vs paper #772 255 places worse
paper 0.6649 ±0.0228
paper 0.6649 ±0.0228 Δ at pub 0.1671
753
ContextPred
0.7175 ±0.0734
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
0.9727
104
GraphCL
actual #104 vs paper #325 221 places worse
0.8250 ±0.0013
best reported
actual #104 vs paper #325 221 places worse
paper 0.7787 ±0.0041
paper 0.7787 ±0.0041 Δ at pub 0.0463
131
GraphSAGE
0.8200 ±0.0100
141
SimGRACE
actual #141 vs paper #258 117 places worse
0.8180 ±0.0015
best reported
actual #141 vs paper #258 117 places worse
paper 0.7912 ±0.0044
paper 0.7912 ±0.0044 Δ at pub 0.0268
146
JOAOv2
actual #146 vs paper #303 157 places worse
0.8170 ±0.0026
best reported
actual #146 vs paper #303 157 places worse
paper 0.7836 ±0.0053
paper 0.7836 ±0.0053 Δ at pub 0.0334
192
FractalGCL
0.8050 ±0.0016
This paper
236
GAE
actual #236 vs paper #426 190 places worse
0.7978 ±0.0017
best reported
actual #236 vs paper #426 190 places worse
paper 0.7436 ±0.0024
paper 0.7436 ±0.0024 Δ at pub 0.0542
239
GradGCL
0.7972 ±0.0053
This paper
277
DRGCL
0.7870 ±0.0040
This paper
283
MGCL
0.7866 ±0.0034
This paper
301
JOAO
actual #301 vs paper #317 16 places worse
0.7840 ±0.0050
best reported
actual #301 vs paper #317 16 places worse
paper 0.7807 ±0.0047

Difference within reported uncertainty; not counted as underperformance.

paper 0.7807 ±0.0047 Δ at pub 0.0033
315
RGCL
0.7814 ±0.0108
This paper
338
InfoGraph
actual #338 vs paper #386 48 places worse
0.7750 ±0.0074
best reported
actual #338 vs paper #386 48 places worse
paper 0.7620 ±0.0106

Difference within reported uncertainty; not counted as underperformance.

paper 0.7620 ±0.0106 Δ at pub 0.0130
388
DGI
actual #388 vs paper #417 29 places worse
0.7620 ±0.0180
best reported
actual #388 vs paper #417 29 places worse
paper 0.7486 ±0.0026
paper 0.7486 ±0.0026 Δ at pub 0.0134
406
graph2vec
actual #406 vs paper #446 40 places worse
0.7540 ±0.0120
best reported
actual #406 vs paper #446 40 places worse
paper 0.7322 ±0.0181

Difference within reported uncertainty; not counted as underperformance.

paper 0.7322 ±0.0181 Δ at pub 0.0218
450
ContextPred
actual #450 vs paper #450
0.7300 ±0.0030
actual #450 vs paper #450
paper 0.7300 ±0.0030
#ModelAccuracy ↑Paper
1
MSH-GNN
0.9410 ±0.0330
2
GRDL
0.8260 ±0.0120
3
GMN
0.8225
32
GIN
0.7880 ±0.0410
149
MLP
0.7600 ±0.0320
162
FractalGCL
0.7585 ±0.0040
This paper
209
SimGRACE
actual #209 vs paper #309 100 places worse
0.7535 ±0.0009
best reported
actual #209 vs paper #309 100 places worse
paper 0.7403 ±0.0009
226
DRGCL
0.7520 ±0.0060
This paper
242
RGCL
0.7503 ±0.0043
This paper
265
GraphCL
actual #265 vs paper #296 31 places worse
0.7489 ±0.0065
best reported
actual #265 vs paper #296 31 places worse
paper 0.7439 ±0.0045

Difference within reported uncertainty; not counted as underperformance.

paper 0.7439 ±0.0045 Δ at pub 0.0050
266
GradGCL
0.7489 ±0.0039
This paper
269
MGCL
0.7485 ±0.0071
This paper
283
JOAO
actual #283 vs paper #288 5 places worse
0.7460 ±0.0040
best reported
actual #283 vs paper #288 5 places worse
paper 0.7455 ±0.0041

Difference within reported uncertainty; not counted as underperformance.

paper 0.7455 ±0.0041 Δ at pub 0.0005 Δ today 0.0005
294
InfoGraph
0.7444 ±0.0031
This paper
309
JOAOv2
0.7407 ±0.0110
This paper
350
graph2vec
0.7330 ±0.0205
This paper
400
DGI
0.7227 ±0.0040
This paper
451
GAE
0.7051 ±0.0017
This paper
455
ContextPred
0.7023 ±0.0063
This paper
#ModelAccuracy ↑Paper
1
GC-GNN (GCN)
0.9210 ±0.0810
2
SUGAR
0.8403 ±0.0133
3
Ortho-g-U-Nets
0.8387
15
SAGE
0.8088 ±0.0233
22
FractalGCL
0.8014 ±0.0012
This paper
47
GradGCL
0.7895 ±0.0047
This paper
49
MGCL
0.7888 ±0.0038
This paper
50
RGCL
0.7886 ±0.0048
This paper
58
GraphCL
0.7862 ±0.0040
This paper
65
DRGCL
0.7840 ±0.0070
This paper
93
SimGRACE
0.7744 ±0.0111
This paper
94
JOAOv2
0.7740 ±0.0115
This paper
98
JOAO
0.7732 ±0.0054
This paper
124
DGI
0.7578 ±0.0034
This paper
141
ContextPred
0.7466 ±0.0051
This paper
145
GAE
0.7454 ±0.0068
This paper
148
InfoGraph
actual #148 vs paper #157 9 places worse
0.7424 ±0.0086
best reported
actual #148 vs paper #157 9 places worse
paper 0.7285 ±0.0178

Difference within reported uncertainty; not counted as underperformance.

paper 0.7285 ±0.0178 Δ at pub 0.0139
169
graph2vec
0.7032 ±0.0232
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published