AAAI 2022

Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning

Jiashun Cheng, Man Li, Jia Li, F. Tsung

Main figure for Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning

Abstract

Graph self-supervised learning (SSL) has been vastly employed to learn representations from unlabeled graphs. Existing methods can be roughly divided into predictive learning and contrastive learning, where the latter one attracts more research attention with better empirical performance. We argue that, however, predictive models weaponed with powerful decoder could achieve comparable or even better representation power than contrastive models. In this work, we propose a Wiener Graph Deconvolutional Network (WGDN), an augmentation-adaptive decoder empowered by graph wiener filter to perform information reconstruction. Theoretical analysis proves the superior reconstruction ability of graph wiener filter. Extensive experimental results on various datasets demonstrate the effectiveness of our approach.

Benchmark Results

Tested on 5 datasets 9 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
actual #2 vs paper #275 273 places worse
0.9669 ±0.0014
best reported
actual #2 vs paper #275 273 places worse
paper 0.9256 ±0.0035
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
8
GCN
actual #8 vs paper #292 284 places worse
0.9632 ±0.0008
best reported
actual #8 vs paper #292 284 places worse
paper 0.9242 ±0.0022
110
WGDN
0.9389 ±0.0031
This paper
111
WGDN_H
0.9389 ±0.0031
This paper
130
AFGRL
actual #130 vs paper #130
0.9361 ±0.0020
actual #130 vs paper #130
paper 0.9361 ±0.0020

Improvement within reported uncertainty; not highlighted.

paper 0.9361 ±0.0020 Δ at pub 0.0039
131
AFGRL_H
0.9361 ±0.0020
This paper
172
BGRL
actual #172 vs paper #172
0.9337 ±0.0021
actual #172 vs paper #172
paper 0.9337 ±0.0021

Improvement within reported uncertainty; not highlighted.

paper 0.9337 ±0.0021 Δ at pub 0.0017
173
BGRL_H
0.9337 ±0.0021
This paper
186
CCA-SSG
0.9325 ±0.0021
This paper
187
CCA-SSG_H
0.9325 ±0.0025
This paper
191
GCA
actual #191 vs paper #277 86 places worse
0.9320 ±0.0060
best reported
actual #191 vs paper #277 86 places worse
paper 0.9253 ±0.0016
paper 0.9253 ±0.0016 Δ at pub 0.0060 Δ today 0.0067
201
BGRL_P
0.9315 ±0.0021
This paper
203
GRACE
actual #203 vs paper #324 121 places worse
0.9313 ±0.0017
best reported
actual #203 vs paper #324 121 places worse
paper 0.9215 ±0.0024
paper 0.9215 ±0.0024 Δ at pub 0.0065 Δ today 0.0098
206
MVGRL
actual #206 vs paper #359 153 places worse
0.9310 ±0.0040
best reported
actual #206 vs paper #359 153 places worse
paper 0.9174 ±0.0007
213
DGI
actual #213 vs paper #366 153 places worse
0.9309 ±0.0008
best reported
actual #213 vs paper #366 153 places worse
paper 0.9161 ±0.0022
216
AFGRL_P
0.9306 ±0.0027
This paper
219
BGRL_N
0.9301 ±0.0020
This paper
225
WGDN_P
0.9296 ±0.0019
This paper
224
AFGRL_N
0.9296 ±0.0025
This paper
234
GDN
0.9284 ±0.0007
This paper
244
CCA-SSG_P
0.9279 ±0.0025
This paper
303
CCA-SSG_N
0.9238 ±0.0033
This paper
315
WGDN_N
0.9226 ±0.0037
This paper
352
GAE
actual #352 vs paper #366 14 places worse
0.9185 ±0.0006
best reported
actual #352 vs paper #366 14 places worse
paper 0.9162 ±0.0013
paper 0.9162 ±0.0013 Δ at pub 0.0023
390
MLP
0.9128 ±0.0063
391
GALA
0.9127 ±0.0012
This paper
443
DeepWalk + feat.
actual #443 vs paper #443
0.9010 ±0.0010
best reported
actual #443 vs paper #443
paper 0.9005 ±0.0008

Difference within reported uncertainty; not counted as underperformance.

paper 0.9005 ±0.0008 Δ at pub 0.0005
457
Node2Vec
actual #457 vs paper #458 1 place worse
0.8970 ±0.0010
best reported
actual #457 vs paper #458 1 place worse
paper 0.8967 ±0.0012

Difference within reported uncertainty; not counted as underperformance.

paper 0.8967 ±0.0012 Δ at pub 0.0003 Δ today 0.0003
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9461 ±0.0017
2
GCN
actual #2 vs paper #269 267 places worse
0.9412 ±0.0008
best reported
actual #2 vs paper #269 267 places worse
paper 0.8651 ±0.0054
paper 0.8651 ±0.0054 Δ at pub 0.0134 Δ today 0.0761
3
GAT
actual #3 vs paper #256 253 places worse
0.9398 ±0.0022
best reported
actual #3 vs paper #256 253 places worse
paper 0.8693 ±0.0029
8
SAGE
0.9351 ±0.0006
79
BGRL
actual #79 vs paper #122 43 places worse
0.9034 ±0.0019
best reported
actual #79 vs paper #122 43 places worse
paper 0.8970 ±0.0015
paper 0.8970 ±0.0015 Δ at pub 0.0060 Δ today 0.0064
112
AFGRL
actual #112 vs paper #133 21 places worse
0.8988 ±0.0033
best reported
actual #112 vs paper #133 21 places worse
paper 0.8958 ±0.0045

Difference within reported uncertainty; not counted as underperformance.

paper 0.8958 ±0.0045 Δ at pub 0.0030 Δ today 0.0030
121
WGDN
0.8972 ±0.0048
This paper
122
WGDN_H
0.8972 ±0.0048
This paper
123
BGRL_H
0.8970 ±0.0015
This paper
129
BGRL_P
0.8963 ±0.0017
This paper
133
WGDN_P
0.8959 ±0.0045
This paper
134
AFGRL_H
0.8958 ±0.0045
This paper
139
GRACE
actual #139 vs paper #282 143 places worse
0.8953 ±0.0035
best reported
actual #139 vs paper #282 143 places worse
paper 0.8625 ±0.0025
paper 0.8625 ±0.0025 Δ at pub 0.0325 Δ today 0.0328
141
BGRL_N
0.8949 ±0.0021
This paper
146
AFGRL_P
0.8933 ±0.0037
This paper
156
WGDN_N
0.8903 ±0.0046
This paper
159
CCA-SSG
actual #159 vs paper #200 41 places worse
0.8896 ±0.0013
best reported
actual #159 vs paper #200 41 places worse
paper 0.8815 ±0.0035
paper 0.8815 ±0.0035 Δ today 0.0081
160
GCA
0.8894 ±0.0015
This paper
163
AFGRL_N
0.8891 ±0.0037
This paper
179
MVGRL
actual #179 vs paper #235 56 places worse
0.8861 ±0.0064
best reported
actual #179 vs paper #235 56 places worse
paper 0.8752 ±0.0011
201
CCA-SSG_H
0.8815 ±0.0035
This paper
210
DGI
actual #210 vs paper #354 144 places worse
0.8798 ±0.0081
best reported
actual #210 vs paper #354 144 places worse
paper 0.8395 ±0.0047
paper 0.8395 ±0.0047 Δ at pub 0.0005 Δ today 0.0403
226
GDN
0.8767 ±0.0017
This paper
229
GALA
0.8761 ±0.0006
This paper
243
CCA-SSG_N
0.8735 ±0.0030
This paper
245
CCA-SSG_P
0.8727 ±0.0046
This paper
264
GAE
actual #264 vs paper #305 41 places worse
0.8666 ±0.0007
best reported
actual #264 vs paper #305 41 places worse
paper 0.8527 ±0.0019
paper 0.8527 ±0.0019 Δ at pub 0.0139
279
DeepWalk + feat.
0.8628 ±0.0007
This paper
320
MLP
0.8463
330
Node2Vec
actual #330 vs paper #334 4 places worse
0.8440 ±0.0010
best reported
actual #330 vs paper #334 4 places worse
paper 0.8439 ±0.0008

Difference within reported uncertainty; not counted as underperformance.

paper 0.8439 ±0.0008 Δ today 0.0001
#ModelAccuracy ↑Paper
1
GrokFormer
0.9831 ±0.0018
2
PolyFormer
0.9808 ±0.0027
3
SGFormer
0.9796 ±0.0081
6
GAT
actual #6 vs paper #122 116 places worse
0.9782 ±0.0028
best reported
actual #6 vs paper #122 116 places worse
paper 0.9547 ±0.0015
paper 0.9547 ±0.0015 Δ at pub 0.0073 Δ today 0.0235
9
GCN
actual #9 vs paper #90 81 places worse
0.9774 ±0.0035
best reported
actual #9 vs paper #90 81 places worse
paper 0.9565 ±0.0016
paper 0.9565 ±0.0016 Δ at pub 0.0085 Δ today 0.0209
17
SAGE
0.9739 ±0.0018
58
MLP
0.9597 ±0.0007
63
GCA
actual #63 vs paper #80 17 places worse
0.9590 ±0.0020
best reported
actual #63 vs paper #80 17 places worse
paper 0.9573 ±0.0003

Difference within reported uncertainty; not counted as underperformance.

paper 0.9573 ±0.0003 Δ today 0.0017
69
BGRL
actual #69 vs paper #139 70 places worse
0.9580 ±0.0040
best reported
actual #69 vs paper #139 70 places worse
paper 0.9528 ±0.0006
paper 0.9528 ±0.0006 Δ at pub 0.0042 Δ today 0.0052
75
WGDN
0.9576 ±0.0011
This paper
76
WGDN_H
0.9576 ±0.0011
This paper
77
GRACE
actual #77 vs paper #140 63 places worse
0.9526 ±0.0002
actual #77 vs paper #140 63 places worse
paper 0.9526 ±0.0002

Improvement within reported uncertainty; not highlighted.

paper 0.9526 ±0.0002 Δ at pub 0.0006 Δ today 0.0048
78
AFGRL
actual #78 vs paper #78
0.9574 ±0.0010
actual #78 vs paper #78
paper 0.9574 ±0.0010

Improvement within reported uncertainty; not highlighted.

paper 0.9574 ±0.0010 Δ at pub 0.0005
79
AFGRL_H
0.9574 ±0.0010
This paper
84
AFGRL_P
0.9571 ±0.0010
This paper
106
CCA-SSG
0.9559 ±0.0007
This paper
107
CCA-SSG_H
0.9559 ±0.0007
This paper
110
AFGRL_N
0.9554 ±0.0009
This paper
125
MVGRL
actual #125 vs paper #134 9 places worse
0.9544 ±0.0027
best reported
actual #125 vs paper #134 9 places worse
paper 0.9533 ±0.0003

Difference within reported uncertainty; not counted as underperformance.

paper 0.9533 ±0.0003 Δ today 0.0011
131
WGDN_P
0.9540 ±0.0023
This paper
135
WGDN_N
0.9533 ±0.0002
This paper
140
BGRL_P
0.9528 ±0.0006
This paper
142
BGRL_H
0.9524 ±0.0009
This paper
143
GALA
0.9523 ±0.0004
This paper
144
GDN
0.9522 ±0.0005
This paper
146
GAE
actual #146 vs paper #161 15 places worse
0.9520 ±0.0010
best reported
actual #146 vs paper #161 15 places worse
paper 0.9492 ±0.0007
paper 0.9492 ±0.0007 Δ today 0.0028
150
BGRL_N
0.9514 ±0.0006
This paper
151
CCA-SSG_N
0.9514 ±0.0007
This paper
156
CCA-SSG_P
0.9512 ±0.0013
This paper
162
DeepWalk + feat.
0.9490 ±0.0009
This paper
167
DGI
actual #167 vs paper #174 7 places worse
0.9489 ±0.0009
best reported
actual #167 vs paper #174 7 places worse
paper 0.9451 ±0.0052

Difference within reported uncertainty; not counted as underperformance.

paper 0.9451 ±0.0052 Δ today 0.0038
268
Node2Vec
actual #268 vs paper #268
0.9120 ±0.0010
best reported
actual #268 vs paper #268
paper 0.9119 ±0.0004

Difference within reported uncertainty; not counted as underperformance.

paper 0.9119 ±0.0004 Δ at pub 0.0001 Δ today 0.0001

TU Dortmund

#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
0.9727
131
GraphSAGE
0.8200 ±0.0100
186
WGDN
0.8070 ±0.0039
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9792
2
MSH-GNN
0.9640 ±0.0070
3
CoCN
0.8722 ±0.0013
23
GCN
0.8260 ±0.0220
40
WGDN
0.8176 ±0.0024
This paper
151
MLP
0.7920 ±0.0240
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere