Learning Graph Augmentations to Learn Graph Representations

Kaveh Hassani, Amir Hosein Khas Ahmadi

Main figure for Learning Graph Augmentations to Learn Graph Representations

Abstract

Devising augmentations for graph contrastive learning is challenging due to their irregular structure, drastic distribution shifts, and nonequivalent feature spaces across datasets. We introduce LG2AR, Learning Graph Augmentations to Learn Graph Representations, which is an end-to-end automatic graph augmentation framework that helps encoders learn generalizable representations on both node and graph levels. LG2AR consists of a probabilistic policy that learns a distribution over augmentations and a set of probabilistic augmentation heads that learn distributions over augmentation parameters. We show that LG2AR achieves state-of-the-art results on 18 out of 20 graph-level and node-level benchmarks compared to previous unsupervised models under both linear and semi-supervised evaluation protocols. The source code will be released here: https://github.com/kavehhassani/lg2ar

Benchmark Results

Tested on 6 datasets 13 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
actual #2 vs paper #269 267 places worse
0.9260 ±0.0040
actual #2 vs paper #269 267 places worse
paper 0.9260 ±0.0040

Improvement within reported uncertainty; not highlighted.

paper 0.9260 ±0.0040 Δ at pub 0.0004 Δ today 0.0409
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
8
GCN
actual #8 vs paper #294 286 places worse
0.9632 ±0.0008
best reported
actual #8 vs paper #294 286 places worse
paper 0.9240 ±0.0020
paper 0.9240 ±0.0020 Δ at pub 0.0002 Δ today 0.0392
95
LG2AR + GRU
0.9410 ±0.0040
This paper
172
BGRL
actual #172 vs paper #190 18 places worse
0.9320 ±0.0030
actual #172 vs paper #190 18 places worse
paper 0.9320 ±0.0030

Improvement within reported uncertainty; not highlighted.

paper 0.9320 ±0.0030 Δ at pub 0.0013
191
GCA
actual #191 vs paper #324 133 places worse
0.9320 ±0.0060
best reported
actual #191 vs paper #324 133 places worse
paper 0.9220 ±0.0020
paper 0.9220 ±0.0020 Δ at pub 0.0093 Δ today 0.0100
203
GRACE
actual #203 vs paper #237 34 places worse
0.9280 ±0.0050
actual #203 vs paper #237 34 places worse
paper 0.9280 ±0.0050

Improvement within reported uncertainty; not highlighted.

paper 0.9280 ±0.0050 Δ at pub 0.0034
206
MVGRL
actual #206 vs paper #362 156 places worse
0.9310 ±0.0040
best reported
actual #206 vs paper #362 156 places worse
paper 0.9170 ±0.0010
paper 0.9170 ±0.0010 Δ at pub 0.0004 Δ today 0.0140
213
DGI
actual #213 vs paper #366 153 places worse
0.9309 ±0.0008
best reported
actual #213 vs paper #366 153 places worse
paper 0.9160 ±0.0020
270
LG2AR + DeepSet
0.9260 ±0.0050
This paper
300
LG2AR + Random
0.9240 ±0.0060
This paper
317
VGAE
actual #317 vs paper #324 7 places worse
0.9224
best reported
actual #317 vs paper #324 7 places worse
paper 0.9220 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.9220 ±0.0010 Δ at pub 0.0004
328
GIN
actual #328 vs paper #402 74 places worse
0.9211 ±0.0032
best reported
actual #328 vs paper #402 74 places worse
paper 0.9090 ±0.0050
best today: Union Subgraph Neural Networks (AAAI 2023)
paper 0.9090 ±0.0050 Δ today 0.0121
352
GAE
actual #352 vs paper #366 14 places worse
0.9185 ±0.0006
best reported
actual #352 vs paper #366 14 places worse
paper 0.9160 ±0.0010
paper 0.9160 ±0.0010 Δ at pub 0.0008 Δ today 0.0025
390
MLP
0.9128 ±0.0063
408
GMI
actual #408 vs paper #416 8 places worse
0.9070 ±0.0020
actual #408 vs paper #416 8 places worse
paper 0.9070 ±0.0020

Improvement within reported uncertainty; not highlighted.

paper 0.9070 ±0.0020 Δ at pub 0.0002
443
DeepWalk + feat.
0.9010 ±0.0010
This paper
444
DeepWalk
actual #444 vs paper #465 21 places worse
0.9005 ±0.0008
best reported
actual #444 vs paper #465 21 places worse
paper 0.8940 ±0.0010
paper 0.8940 ±0.0010 Δ at pub 0.0065 Δ today 0.0065
457
Node2Vec
actual #457 vs paper #457
0.8970 ±0.0010
actual #457 vs paper #457
paper 0.8970 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.8970 ±0.0010 Δ at pub 0.0003
531
Raw features
actual #531 vs paper #540 9 places worse
0.7999 ±0.0090
best reported
actual #531 vs paper #540 9 places worse
paper 0.7850
paper 0.7850 Δ at pub 0.0003 Δ today 0.0149
#ModelAccuracy ↑Paper
1
GrokFormer
0.9831 ±0.0018
2
PolyFormer
0.9808 ±0.0027
3
SGFormer
0.9796 ±0.0081
6
GAT
actual #6 vs paper #116 110 places worse
0.9782 ±0.0028
best reported
actual #6 vs paper #116 110 places worse
paper 0.9550 ±0.0020
paper 0.9550 ±0.0020 Δ at pub 0.0070 Δ today 0.0232
9
GCN
actual #9 vs paper #84 75 places worse
0.9774 ±0.0035
best reported
actual #9 vs paper #84 75 places worse
paper 0.9570 ±0.0020
paper 0.9570 ±0.0020 Δ at pub 0.0080 Δ today 0.0204
17
SAGE
0.9739 ±0.0018
58
MLP
0.9597 ±0.0007
63
GCA
actual #63 vs paper #84 21 places worse
0.9590 ±0.0020
best reported
actual #63 vs paper #84 21 places worse
paper 0.9570
69
BGRL
actual #69 vs paper #84 15 places worse
0.9570 ±0.0010
actual #69 vs paper #84 15 places worse
paper 0.9570 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.9570 ±0.0010 Δ at pub 0.0014
88
LG2AR + GRU
0.9570 ±0.0020
This paper
120
LG2AR + DeepSet
0.9550 ±0.0010
This paper
125
MVGRL
actual #125 vs paper #136 11 places worse
0.9544 ±0.0027
best reported
actual #125 vs paper #136 11 places worse
paper 0.9530

Difference within reported uncertainty; not counted as underperformance.

paper 0.9530 Δ at pub 0.0003 Δ today 0.0014
128
LG2AR + Random
0.9540 ±0.0010
This paper
137
GIN
actual #137 vs paper #144 7 places worse
0.9530 ±0.0010
best reported
actual #137 vs paper #144 7 places worse
paper 0.9520 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.9520 ±0.0010 Δ today 0.0010
146
GAE
actual #146 vs paper #161 15 places worse
0.9520 ±0.0010
best reported
actual #146 vs paper #161 15 places worse
paper 0.9492 ±0.0010
paper 0.9492 ±0.0010 Δ today 0.0028
163
DeepWalk
actual #163 vs paper #262 99 places worse
0.9490
best reported
actual #163 vs paper #262 99 places worse
paper 0.9180 ±0.0020
paper 0.9180 ±0.0020 Δ at pub 0.0310
162
DeepWalk + feat.
0.9490 ±0.0010
This paper
167
DGI
actual #167 vs paper #174 7 places worse
0.9489 ±0.0009
best reported
actual #167 vs paper #174 7 places worse
paper 0.9450 ±0.0050

Difference within reported uncertainty; not counted as underperformance.

paper 0.9450 ±0.0050 Δ at pub 0.0001 Δ today 0.0039
174
VGAE
actual #174 vs paper #174
0.9452
best reported
actual #174 vs paper #174
paper 0.9450
182
Raw features
actual #182 vs paper #206 24 places worse
0.9360
actual #182 vs paper #206 24 places worse
paper 0.9360
paper 0.9360 Δ at pub 0.0002 Δ today 0.0072
268
Node2Vec
actual #268 vs paper #268
0.9120
actual #268 vs paper #268
paper 0.9120

Improvement within reported uncertainty; not highlighted.

paper 0.9120 Δ at pub 0.0001
#ModelAccuracy ↑Paper
1
GCN
actual #1 vs paper #201 200 places worse
0.9302 ±0.0011
best reported
actual #1 vs paper #201 200 places worse
paper 0.7720 ±0.0010
paper 0.7720 ±0.0010 Δ today 0.1582
2
RSE + RGCN (70b)
0.8852 ±0.0019
3
LEMP+T
0.8825
9
SAGE
0.8771
31
GAT
actual #31 vs paper #186 155 places worse
0.8533
best reported
actual #31 vs paper #186 155 places worse
paper 0.7770 ±0.0010
54
GIN
actual #54 vs paper #218 164 places worse
0.8303 ±0.0021
best reported
actual #54 vs paper #218 164 places worse
paper 0.7590 ±0.0070
94
GRACE
actual #94 vs paper #96 2 places worse
0.8014 ±0.0048
best reported
actual #94 vs paper #96 2 places worse
paper 0.8010 ±0.0050

Difference within reported uncertainty; not counted as underperformance.

paper 0.8010 ±0.0050 Δ at pub 0.0004 Δ today 0.0004
100
BGRL
actual #100 vs paper #100
0.8000 ±0.0010
actual #100 vs paper #100
paper 0.8000 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.8000 ±0.0010 Δ at pub 0.0002
151
DGI
actual #151 vs paper #226 75 places worse
0.7540 ±0.0010
actual #151 vs paper #226 75 places worse
paper 0.7540 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.7540 ±0.0010 Δ at pub 0.0005
162
GCA
actual #162 vs paper #162
0.7840 ±0.0010
actual #162 vs paper #162
paper 0.7840 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.7840 ±0.0010 Δ at pub 0.0005
181
GAE
actual #181 vs paper #265 84 places worse
0.7020
actual #181 vs paper #265 84 places worse
paper 0.7020
paper 0.7020 Δ at pub 0.0005 Δ today 0.0767
180
VGAE
actual #180 vs paper #222 42 places worse
0.7787 ±0.0053
best reported
actual #180 vs paper #222 42 places worse
paper 0.7560 ±0.0020
paper 0.7560 ±0.0020 Δ at pub 0.0003 Δ today 0.0227
185
LG2AR + GRU
0.7780 ±0.0050
This paper
190
MVGRL
actual #190 vs paper #192 2 places worse
0.7757 ±0.0046
best reported
actual #190 vs paper #192 2 places worse
paper 0.7750

Difference within reported uncertainty; not counted as underperformance.

paper 0.7750 Δ at pub 0.0002 Δ today 0.0007
198
DeepWalk
actual #198 vs paper #238 40 places worse
0.7721
best reported
actual #198 vs paper #238 40 places worse
paper 0.7440 ±0.0010
paper 0.7440 ±0.0010 Δ at pub 0.0281
200
DeepWalk + feat.
actual #200 vs paper #201 1 place worse
0.7721 ±0.0300
best reported
actual #200 vs paper #201 1 place worse
paper 0.7720

Difference within reported uncertainty; not counted as underperformance.

paper 0.7720 Δ at pub 0.0001
217
LG2AR + DeepSet
0.7620 ±0.0090
This paper
218
LG2AR + Random
0.7620 ±0.0070
This paper
234
GMI
actual #234 vs paper #234
0.7490 ±0.0010
actual #234 vs paper #234
paper 0.7490 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.7490 ±0.0010 Δ at pub 0.0005
237
MLP
0.7469 ±0.0085
256
Raw features
0.7198
This paper
258
Node2Vec
actual #258 vs paper #258
0.7180 ±0.0010
actual #258 vs paper #258
paper 0.7180 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.7180 ±0.0010 Δ at pub 0.0001
#ModelAccuracy ↑Paper
1
DoG
0.9690 ±0.0030
2
GWN-fa
0.9667 ±0.0026
3
GWN-sym
0.9666 ±0.0026
6
GraphSAGE
0.9593 ±0.0025
12
GCN
actual #12 vs paper #69 57 places worse
0.9514 ±0.0025
best reported
actual #12 vs paper #69 57 places worse
paper 0.9300 ±0.0030
best today: Graph Wave Networks (WWW 2025)
paper 0.9300 ±0.0030 Δ at pub 0.0060 Δ today 0.0214
21
GAT
actual #21 vs paper #107 86 places worse
0.9437 ±0.0028
best reported
actual #21 vs paper #107 86 places worse
paper 0.9230 ±0.0020
best today: Graph Wave Networks (WWW 2025)
paper 0.9230 ±0.0020 Δ at pub 0.0150 Δ today 0.0207
39
LG2AR + GRU
0.9360 ±0.0030
This paper
43
DGI
actual #43 vs paper #113 70 places worse
0.9350 ±0.0030
best reported
actual #43 vs paper #113 70 places worse
paper 0.9220 ±0.0060
51
GCA
actual #51 vs paper #63 12 places worse
0.9332 ±0.0012
best reported
actual #51 vs paper #63 12 places worse
paper 0.9310
53
BGRL
actual #53 vs paper #54 1 place worse
0.9331 ±0.0013
best reported
actual #53 vs paper #54 1 place worse
paper 0.9330 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.9330 ±0.0010 Δ today 0.0001
69
GRACE
actual #69 vs paper #148 79 places worse
0.9301 ±0.0003
best reported
actual #69 vs paper #148 79 places worse
paper 0.9110 ±0.0020
paper 0.9110 ±0.0020 Δ at pub 0.0170 Δ today 0.0191
88
MLP
0.9280 ±0.0020
105
LG2AR + DeepSet
0.9240 ±0.0030
This paper
108
LG2AR + Random
0.9230 ±0.0020
This paper
117
VGAE
actual #117 vs paper #118 1 place worse
0.9211 ±0.0009
best reported
actual #117 vs paper #118 1 place worse
paper 0.9210 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.9210 ±0.0010 Δ at pub 0.0001 Δ today 0.0001
116
MVGRL
actual #116 vs paper #118 2 places worse
0.9211 ±0.0012
best reported
actual #116 vs paper #118 2 places worse
paper 0.9210 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.9210 ±0.0010 Δ at pub 0.0001 Δ today 0.0001
138
GIN
0.9140 ±0.0020
This paper
158
Raw features
actual #158 vs paper #158
0.9040
actual #158 vs paper #158
paper 0.9040
paper 0.9040 Δ at pub 0.0003
163
GAE
actual #163 vs paper #163
0.9005 ±0.0035
best reported
actual #163 vs paper #163
paper 0.9000 ±0.0070

Difference within reported uncertainty; not counted as underperformance.

paper 0.9000 ±0.0070 Δ at pub 0.0001 Δ today 0.0005
176
DeepWalk + feat.
0.8770
This paper
184
Node2Vec
actual #184 vs paper #184
0.8510
actual #184 vs paper #184
paper 0.8510

Improvement within reported uncertainty; not highlighted.

paper 0.8510 Δ at pub 0.0002
188
DeepWalk
actual #188 vs paper #188
0.8461 ±0.0022
best reported
actual #188 vs paper #188
paper 0.8460 ±0.0020

Difference within reported uncertainty; not counted as underperformance.

paper 0.8460 ±0.0020 Δ at pub 0.0001 Δ today 0.0001

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
actual #39 vs paper #237 198 places worse
0.9330 ±0.0290
best reported
actual #39 vs paper #237 198 places worse
paper 0.8940 ±0.0560

Difference within reported uncertainty; not counted as underperformance.

paper 0.8940 ±0.0560 Δ at pub 0.0390
63
GCN
actual #63 vs paper #432 369 places worse
0.9220 ±0.0440
best reported
actual #63 vs paper #432 369 places worse
paper 0.8560 ±0.0580

Difference within reported uncertainty; not counted as underperformance.

paper 0.8560 ±0.0580 Δ at pub 0.0350 Δ today 0.0660
159
WL
actual #159 vs paper #597 438 places worse
0.9040 ±0.0570
best reported
actual #159 vs paper #597 438 places worse
paper 0.8070 ±0.0300
paper 0.8070 ±0.0300 Δ at pub 0.0550 Δ today 0.0970
158
GraphSAGE
0.9040 ±0.0780
183
GAT
actual #183 vs paper #237 54 places worse
0.9010 ±0.0580
best reported
actual #183 vs paper #237 54 places worse
paper 0.8940 ±0.0610

Difference within reported uncertainty; not counted as underperformance.

paper 0.8940 ±0.0610 Δ at pub 0.0070 Δ today 0.0070
195
LG2AR + GRU
0.9000 ±0.0060
This paper
215
ADGCL
0.8970 ±0.0100
This paper
257
InfoGraph
actual #257 vs paper #272 15 places worse
0.8930 ±0.0514
best reported
actual #257 vs paper #272 15 places worse
paper 0.8900 ±0.0110
best at pub: Graph Contrastive Learning Automated (ICML 2021)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8900 ±0.0110 Δ at pub 0.0001 Δ today 0.0030
283
LG2AR + DeepSet
0.8890 ±0.0060
This paper
305
LG2AR + Random
0.8860 ±0.0050
This paper
332
MLG
actual #332 vs paper #334 2 places worse
0.8794 ±0.0161
best reported
actual #332 vs paper #334 2 places worse
paper 0.8790 ±0.0160
best at pub: The Multiscale Laplacian Graph Kernel (NeurIPS 2016)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8790 ±0.0160 Δ at pub 0.0004
351
JOAO
0.8770 ±0.0080
This paper
354
GraphCL
actual #354 vs paper #396 42 places worse
0.8766 ±0.0103
best reported
actual #354 vs paper #396 42 places worse
paper 0.8680 ±0.0140
best at pub: Graph Contrastive Learning Automated (ICML 2021)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8680 ±0.0140 Δ today 0.0086
365
DGK
actual #365 vs paper #366 1 place worse
0.8744 ±0.0272
best reported
actual #365 vs paper #366 1 place worse
paper 0.8740 ±0.0270
best at pub: Provably Powerful Graph Networks (NeurIPS 2019)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8740 ±0.0270 Δ at pub 0.0004 Δ today 0.0004
403
MLP
0.8660 ±0.0495
407
graph2vec
actual #407 vs paper #515 108 places worse
0.8644 ±0.0125
best reported
actual #407 vs paper #515 108 places worse
paper 0.8320 ±0.0960

Difference within reported uncertainty; not counted as underperformance.

paper 0.8320 ±0.0960 Δ at pub 0.0048 Δ today 0.0324
426
SP
actual #426 vs paper #443 17 places worse
0.8580 ±0.0020
best reported
actual #426 vs paper #443 17 places worse
paper 0.8520 ±0.0240
best at pub: Propagation Kernels (2014)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8520 ±0.0240 Δ at pub 0.0060
472
Sub2Vec
actual #472 vs paper #786 314 places worse
0.8447 ±0.0037
best reported
actual #472 vs paper #786 314 places worse
paper 0.6110 ±0.1580

Difference within reported uncertainty; not counted as underperformance.

paper 0.6110 ±0.1580 Δ at pub 0.0050 Δ today 0.2337
500
random walk
0.8370 ±0.0150
This paper
506
GK
actual #506 vs paper #575 69 places worse
0.8350 ±0.0060
best reported
actual #506 vs paper #575 69 places worse
paper 0.8170 ±0.0210

Difference within reported uncertainty; not counted as underperformance.

paper 0.8170 ±0.0210 Δ today 0.0180
746
Node2Vec
actual #746 vs paper #746
0.7263 ±0.1020
best reported
actual #746 vs paper #746
paper 0.7260 ±0.1020
best at pub: Graph Contrastive Learning Automated (ICML 2021)

Difference within reported uncertainty; not counted as underperformance.

paper 0.7260 ±0.1020 Δ at pub 0.0003 Δ today 0.0003
#ModelAccuracy ↑Paper
1
WL-MLP
0.9792
2
MSH-GNN
0.9640 ±0.0070
3
CoCN
0.8722 ±0.0013
23
GCN
0.8260 ±0.0220
146
InfoGraph
actual #146 vs paper #294 148 places worse
0.7940
best reported
actual #146 vs paper #294 148 places worse
paper 0.7070 ±0.0110
paper 0.7070 ±0.0110 Δ at pub 0.0870
151
MLP
0.7920 ±0.0240
183
LG2AR + GRU
0.7780 ±0.0020
This paper
184
LG2AR + DeepSet
0.7780 ±0.0020
This paper
190
LG2AR + Random
0.7760 ±0.0020
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Improved at pub — later paper surpassed this result Best today — OK at publication; today's leaderboard best is elsewhere