GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling

Wei Ju, Yiyang Gu, Zhengyang Mao, Ziyue Qiao, Yifang Qin, Xiao Luo, Hui Xiong, Ming Zhang

Main figure for GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling

Abstract

Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising performance for representation learning on graphs, which train models by maximizing agreement between original graphs and their augmented views (i.e., positive views). Unfortunately, these methods usually involve pre-defined augmentation strategies based on the knowledge of human experts. Moreover, these strategies may fail to generate challenging positive views to provide sufficient supervision signals. In this paper, we present a novel approach named graph pooling contrast (GPS) to address these issues. Motivated by the fact that graph pooling can adaptively coarsen the graph with the removal of redundancy, we rethink graph pooling and leverage it to automatically generate multi-scale positive views with varying emphasis on providing challenging positives and preserving semantics, i.e., strongly-augmented view and weakly-augmented view. Then, we incorporate both views into a joint contrastive learning framework with similarity learning and consistency learning, where our pooling module is adversarially trained with respect to the encoder for adversarial robustness. Experiments on twelve datasets on both graph classification and transfer learning tasks verify the superiority of the proposed method over its counterparts.

Benchmark Results

Tested on 4 datasets 12 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
actual #39 vs paper #237 198 places worse
0.9330 ±0.0290
best reported
actual #39 vs paper #237 198 places worse
paper 0.8940 ±0.0560

Difference within reported uncertainty; not counted as underperformance.

paper 0.8940 ±0.0560 Δ at pub 0.0390
63
GCN
actual #63 vs paper #432 369 places worse
0.9220 ±0.0440
best reported
actual #63 vs paper #432 369 places worse
paper 0.8560 ±0.0580

Difference within reported uncertainty; not counted as underperformance.

paper 0.8560 ±0.0580 Δ at pub 0.0350 Δ today 0.0660
158
GraphSAGE
actual #158 vs paper #446 288 places worse
0.9040 ±0.0780
best reported
actual #158 vs paper #446 288 places worse
paper 0.8510 ±0.0760

Difference within reported uncertainty; not counted as underperformance.

paper 0.8510 ±0.0760 Δ at pub 0.0530
159
WL
actual #159 vs paper #597 438 places worse
0.9040 ±0.0570
best reported
actual #159 vs paper #597 438 places worse
paper 0.8070 ±0.0300
paper 0.8070 ±0.0300 Δ at pub 0.0970
178
AD-GCL
actual #178 vs paper #256 78 places worse
0.9028 ±0.0401
best reported
actual #178 vs paper #256 78 places worse
paper 0.8930 ±0.0150

Difference within reported uncertainty; not counted as underperformance.

paper 0.8930 ±0.0150 Δ at pub 0.0098
183
GAT
actual #183 vs paper #237 54 places worse
0.9010 ±0.0580
best reported
actual #183 vs paper #237 54 places worse
paper 0.8940 ±0.0610

Difference within reported uncertainty; not counted as underperformance.

paper 0.8940 ±0.0610 Δ at pub 0.0070 Δ today 0.0070
206
GPS-TopK
0.8990 ±0.0070
This paper
233
GPS-Cluster
0.8950 ±0.0120
This paper
257
InfoGraph
actual #257 vs paper #272 15 places worse
0.8930 ±0.0514
best reported
actual #257 vs paper #272 15 places worse
paper 0.8900 ±0.0110

Difference within reported uncertainty; not counted as underperformance.

paper 0.8900 ±0.0110 Δ at pub 0.0030
264
GraphCLA
0.8930 ±0.0040
This paper
272
SimGRACE
actual #272 vs paper #272
0.8910 ±0.0140
actual #272 vs paper #272
paper 0.8910 ±0.0140

Improvement within reported uncertainty; not highlighted.

paper 0.8910 ±0.0140 Δ at pub 0.0009
351
JOAO
actual #351 vs paper #371 20 places worse
0.8770 ±0.0080
best reported
actual #351 vs paper #371 20 places worse
paper 0.8730 ±0.0100

Difference within reported uncertainty; not counted as underperformance.

paper 0.8730 ±0.0100 Δ at pub 0.0040 Δ today 0.0040
354
GraphCL
actual #354 vs paper #396 42 places worse
0.8766 ±0.0103
best reported
actual #354 vs paper #396 42 places worse
paper 0.8680 ±0.0130

Difference within reported uncertainty; not counted as underperformance.

paper 0.8680 ±0.0130 Δ at pub 0.0086
403
MLP
0.8660 ±0.0495
407
graph2vec
actual #407 vs paper #515 108 places worse
0.8644 ±0.0125
best reported
actual #407 vs paper #515 108 places worse
paper 0.8320 ±0.0960

Difference within reported uncertainty; not counted as underperformance.

paper 0.8320 ±0.0960 Δ at pub 0.0324
426
SP
actual #426 vs paper #443 17 places worse
0.8580 ±0.0020
best reported
actual #426 vs paper #443 17 places worse
paper 0.8520 ±0.0240
best at pub: Propagation Kernels (2014)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8520 ±0.0240 Δ at pub 0.0060
472
Sub2Vec
actual #472 vs paper #786 314 places worse
0.8447 ±0.0037
best reported
actual #472 vs paper #786 314 places worse
paper 0.6110 ±0.1580

Difference within reported uncertainty; not counted as underperformance.

paper 0.6110 ±0.1580 Δ at pub 0.2337
506
GK
actual #506 vs paper #575 69 places worse
0.8350 ±0.0060
best reported
actual #506 vs paper #575 69 places worse
paper 0.8170 ±0.0210

Difference within reported uncertainty; not counted as underperformance.

paper 0.8170 ±0.0210 Δ at pub 0.0180
718
SAGE
0.7490 ±0.0870
746
Node2Vec
actual #746 vs paper #746
0.7263 ±0.1020
best reported
actual #746 vs paper #746
paper 0.7260 ±0.1020
best at pub: Graph Contrastive Learning Automated (ICML 2021)

Difference within reported uncertainty; not counted as underperformance.

paper 0.7260 ±0.1020 Δ at pub 0.0003 Δ today 0.0003
#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
actual #2 vs paper #91 89 places worse
0.9934
best reported
actual #2 vs paper #91 89 places worse
paper 0.8270 ±0.0170
paper 0.8270 ±0.0170 Δ at pub 0.1664
3
GCN
actual #3 vs paper #214 211 places worse
0.9727
best reported
actual #3 vs paper #214 211 places worse
paper 0.8020 ±0.0200
paper 0.8020 ±0.0200 Δ at pub 0.1707
4
GAT
actual #4 vs paper #513 509 places worse
0.9623
best reported
actual #4 vs paper #513 509 places worse
paper 0.6660 ±0.0220
paper 0.6660 ±0.0220 Δ at pub 0.2963
104
GraphCL
actual #104 vs paper #325 221 places worse
0.8250 ±0.0013
best reported
actual #104 vs paper #325 221 places worse
paper 0.7790 ±0.0040
paper 0.7790 ±0.0040 Δ at pub 0.0460
131
GraphSAGE
actual #131 vs paper #329 198 places worse
0.8200 ±0.0100
best reported
actual #131 vs paper #329 198 places worse
paper 0.7770 ±0.0150
paper 0.7770 ±0.0150 Δ at pub 0.0430
141
SimGRACE
actual #141 vs paper #258 117 places worse
0.8180 ±0.0015
best reported
actual #141 vs paper #258 117 places worse
paper 0.7910 ±0.0050
paper 0.7910 ±0.0050 Δ at pub 0.0270
249
GPS-Cluster
0.7950 ±0.0040
This paper
260
GPS-TopK
0.7910 ±0.0060
This paper
301
JOAO
actual #301 vs paper #315 14 places worse
0.7840 ±0.0050
best reported
actual #301 vs paper #315 14 places worse
paper 0.7810 ±0.0050

Difference within reported uncertainty; not counted as underperformance.

paper 0.7810 ±0.0050 Δ at pub 0.0030
338
InfoGraph
actual #338 vs paper #386 48 places worse
0.7750 ±0.0074
best reported
actual #338 vs paper #386 48 places worse
paper 0.7620 ±0.0110

Difference within reported uncertainty; not counted as underperformance.

paper 0.7620 ±0.0110 Δ at pub 0.0130
406
graph2vec
actual #406 vs paper #446 40 places worse
0.7540 ±0.0120
best reported
actual #406 vs paper #446 40 places worse
paper 0.7320 ±0.0180

Difference within reported uncertainty; not counted as underperformance.

paper 0.7320 ±0.0180 Δ at pub 0.0220
409
AD-GCL
actual #409 vs paper #489 80 places worse
0.7518 ±0.0031
best reported
actual #409 vs paper #489 80 places worse
paper 0.6970 ±0.0050
paper 0.6970 ±0.0050 Δ at pub 0.0548 Δ today 0.0548
421
SP
actual #421 vs paper #442 21 places worse
0.7450 ±0.0030
best reported
actual #421 vs paper #442 21 places worse
paper 0.7350 ±0.0010
paper 0.7350 ±0.0010 Δ at pub 0.0100
452
GraphCLA
0.7300 ±0.0060
This paper
519
GK
0.6600 ±0.0010
This paper
557
Sub2Vec
actual #557 vs paper #575 18 places worse
0.5976 ±0.0035
best reported
actual #557 vs paper #575 18 places worse
paper 0.5280 ±0.0150
paper 0.5280 ±0.0150 Δ at pub 0.0696
571
Node2Vec
0.5490 ±0.0160
This paper
#ModelAccuracy ↑Paper
1
MSH-GNN
0.9410 ±0.0330
2
GRDL
0.8260 ±0.0120
3
GMN
0.8225
32
GIN
actual #32 vs paper #135 103 places worse
0.7880 ±0.0410
best reported
actual #32 vs paper #135 103 places worse
paper 0.7620 ±0.0280

Difference within reported uncertainty; not counted as underperformance.

paper 0.7620 ±0.0280 Δ at pub 0.0260
49
GAT
actual #49 vs paper #275 226 places worse
0.7800 ±0.0300
best reported
actual #49 vs paper #275 226 places worse
paper 0.7470 ±0.0400

Difference within reported uncertainty; not counted as underperformance.

paper 0.7470 ±0.0400 Δ at pub 0.0330
67
SAGE
0.7726 ±0.0228
148
GCN
actual #148 vs paper #224 76 places worse
0.7600 ±0.0320
best reported
actual #148 vs paper #224 76 places worse
paper 0.7520 ±0.0360

Difference within reported uncertainty; not counted as underperformance.

paper 0.7520 ±0.0360 Δ at pub 0.0080 Δ today 0.0080
149
MLP
0.7600 ±0.0320
155
GraphSAGE
actual #155 vs paper #212 57 places worse
0.7590 ±0.0320
best reported
actual #155 vs paper #212 57 places worse
paper 0.7530 ±0.0240

Difference within reported uncertainty; not counted as underperformance.

paper 0.7530 ±0.0240 Δ at pub 0.0060 Δ today 0.0060
190
WL
actual #190 vs paper #370 180 places worse
0.7560 ±0.0040
best reported
actual #190 vs paper #370 180 places worse
paper 0.7290 ±0.0060
paper 0.7290 ±0.0060 Δ at pub 0.0270
209
SimGRACE
actual #209 vs paper #259 50 places worse
0.7535 ±0.0009
best reported
actual #209 vs paper #259 50 places worse
paper 0.7490 ±0.0070

Difference within reported uncertainty; not counted as underperformance.

paper 0.7490 ±0.0070 Δ at pub 0.0045 Δ today 0.0045
238
GPS-TopK
0.7510 ±0.0040
This paper
265
GraphCL
actual #265 vs paper #294 29 places worse
0.7489 ±0.0065
best reported
actual #265 vs paper #294 29 places worse
paper 0.7440 ±0.0050

Difference within reported uncertainty; not counted as underperformance.

paper 0.7440 ±0.0050 Δ at pub 0.0049
277
GPS-Cluster
0.7470 ±0.0050
This paper
283
JOAO
actual #283 vs paper #283
0.7460 ±0.0040
actual #283 vs paper #283
paper 0.7460 ±0.0040

Improvement within reported uncertainty; not highlighted.

paper 0.7460 ±0.0040 Δ at pub 0.0005
291
GraphCLA
0.7450 ±0.0060
This paper
294
InfoGraph
actual #294 vs paper #294
0.7444 ±0.0040
best reported
actual #294 vs paper #294
paper 0.7440 ±0.0030

Difference within reported uncertainty; not counted as underperformance.

paper 0.7440 ±0.0030 Δ at pub 0.0004 Δ today 0.0004
338
AD-GCL
actual #338 vs paper #338
0.7360 ±0.0070
actual #338 vs paper #338
paper 0.7360 ±0.0070
paper 0.7360 ±0.0070 Δ at pub 0.0370
350
graph2vec
0.7330 ±0.0210
This paper
474
Sub2Vec
actual #474 vs paper #518 44 places worse
0.6731 ±0.0050
best reported
actual #474 vs paper #518 44 places worse
paper 0.5300 ±0.0560
paper 0.5300 ±0.0560 Δ at pub 0.1431
514
Node2Vec
actual #514 vs paper #514
0.5750 ±0.0360
actual #514 vs paper #514
paper 0.5750 ±0.0360

Improvement within reported uncertainty; not highlighted.

paper 0.5750 ±0.0360 Δ at pub 0.0001
#ModelAccuracy ↑Paper
1
SpeGCL
0.5944 ±0.0018
2
GIN
0.5760 ±0.0150
This paper
3
LAMP-Soft
0.5738 ±0.0041
9
GPS-TopK
0.5630 ±0.0020
This paper
11
GraphCL
actual #11 vs paper #11
0.5600 ±0.0030
actual #11 vs paper #11
paper 0.5600 ±0.0030

Improvement within reported uncertainty; not highlighted.

paper 0.5600 ±0.0030 Δ at pub 0.0001
12
SimGRACE
0.5590 ±0.0040
This paper
13
GPS-Cluster
0.5590 ±0.0040
This paper
15
JOAO
0.5570 ±0.0060
This paper
16
AD-GCL
actual #16 vs paper #16
0.5490 ±0.0040
actual #16 vs paper #16
paper 0.5490 ±0.0040
paper 0.5490 ±0.0040 Δ at pub 0.0141
19
InfoGraph
actual #19 vs paper #19
0.5350 ±0.0100
actual #19 vs paper #19
paper 0.5350 ±0.0100

Improvement within reported uncertainty; not highlighted.

paper 0.5350 ±0.0100 Δ at pub 0.0004
23
graph2vec
actual #23 vs paper #23
0.4790 ±0.0030
actual #23 vs paper #23
paper 0.4790 ±0.0030

Improvement within reported uncertainty; not highlighted.

paper 0.4790 ±0.0030 Δ at pub 0.0004
25
WL
actual #25 vs paper #25
0.4610 ±0.0020
actual #25 vs paper #25
paper 0.4610 ±0.0020

Improvement within reported uncertainty; not highlighted.

paper 0.4610 ±0.0020 Δ at pub 0.0004
26
GraphSAGE
0.4380 ±0.0320
This paper
29
GK
0.4100 ±0.0020
This paper
30
SP
0.3960 ±0.0020
This paper
31
Sub2Vec
actual #31 vs paper #31
0.3670 ±0.0040
actual #31 vs paper #31
paper 0.3670 ±0.0040

Improvement within reported uncertainty; not highlighted.

paper 0.3670 ±0.0040 Δ at pub 0.0002
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published