ICLR 2024

Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks

Tianyu Fan, Lirong Wu, Yufei Huang, Haitao Lin, Cheng Tan, Zhangyang Gao, Stan Z. Li

Main figure for Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks

Abstract

Recent years have witnessed the great success of graph pre-training for graph representation learning. With hundreds of graph pre-training tasks proposed, integrating knowledge acquired from multiple pre-training tasks has become a popular research topic. In this paper, we identify two important collaborative processes for this topic: (1) select: how to select an optimal task combination from a given task pool based on their compatibility, and (2) weigh: how to weigh the selected tasks based on their importance. While there currently has been a lot of work focused on weighing, comparatively little effort has been devoted to selecting. This paper proposes a novel instance-level framework for integrating multiple graph pre-training tasks, eigh nd elect (WAS), where the two collaborative processes, weighing and selecting, are combined by decoupled siamese networks. Specifically, it first adaptively learns an optimal combination of tasks for each instance from a given task pool, based on which a customized instance-level task weighing strategy is learned. Extensive experiments on 16 graph datasets across node-level and graph-level downstream tasks have demonstrated that by combining a few simple but classical tasks, WAS can achieve comparable performance to other leading counterparts. The code is available at https://github.com/TianyuFan0504/WAS.

Proposed method: WAS

Benchmark Results

Tested on 9 datasets 53 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
0.9669 ±0.0014
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
136
WAS
0.9360 ±0.0070
This paper
153
AutoSSL
actual #153 vs paper #153
0.9350 ±0.0070
actual #153 vs paper #153
paper 0.9350 ±0.0070

Improvement within reported uncertainty; not highlighted.

paper 0.9350 ±0.0070 Δ at pub 0.0079
169
ParetoGNN
0.9340 ±0.0020
This paper
181
AGSSL
0.9330 ±0.0040
This paper
191
GCA
0.9320 ±0.0060
This paper
203
GRACE
actual #203 vs paper #294 91 places worse
0.9313 ±0.0017
best reported
actual #203 vs paper #294 91 places worse
paper 0.9240 ±0.0030
paper 0.9240 ±0.0030 Δ at pub 0.0040 Δ today 0.0073
206
MVGRL
actual #206 vs paper #206
0.9310 ±0.0040
actual #206 vs paper #206
paper 0.9310 ±0.0040
213
DGI
actual #213 vs paper #340 127 places worse
0.9200 ±0.0060
actual #213 vs paper #340 127 places worse
paper 0.9200 ±0.0060

Improvement within reported uncertainty; not highlighted.

paper 0.9200 ±0.0060 Δ at pub 0.0039 Δ today 0.0109
283
PairSim
0.9250 ±0.0060
This paper
301
Par
0.9240 ±0.0050
This paper
312
Clu
0.9230 ±0.0040
This paper
311
GRLC
actual #311 vs paper #348 37 places worse
0.9230 ±0.0050
best reported
actual #311 vs paper #348 37 places worse
paper 0.9190 ±0.0060

Difference within reported uncertainty; not counted as underperformance.

paper 0.9190 ±0.0060 Δ at pub 0.0040
334
PairDis
0.9210 ±0.0050
This paper
330
CG3
actual #330 vs paper #330
0.9210 ±0.0050
actual #330 vs paper #330
paper 0.9210 ±0.0050
390
MLP
0.9128 ±0.0063
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9461 ±0.0017
2
GCN
0.9412 ±0.0008
3
GAT
0.9398 ±0.0022
8
SAGE
0.9351 ±0.0006
139
GRACE
actual #139 vs paper #184 45 places worse
0.8953 ±0.0035
best reported
actual #139 vs paper #184 45 places worse
paper 0.8850 ±0.0050
paper 0.8850 ±0.0050 Δ at pub 0.0103 Δ today 0.0103
160
GCA
actual #160 vs paper #171 11 places worse
0.8894 ±0.0015
best reported
actual #160 vs paper #171 11 places worse
paper 0.8870 ±0.0020

Difference within reported uncertainty; not counted as underperformance.

paper 0.8870 ±0.0020 Δ at pub 0.0024 Δ today 0.0024
164
WAS
0.8890 ±0.0030
This paper
174
AGSSL
0.8870 ±0.0040
This paper
179
MVGRL
actual #179 vs paper #212 33 places worse
0.8861 ±0.0064
best reported
actual #179 vs paper #212 33 places worse
paper 0.8790 ±0.0020

Difference within reported uncertainty; not counted as underperformance.

paper 0.8790 ±0.0020 Δ today 0.0071
184
GRLC
actual #184 vs paper #206 22 places worse
0.8854 ±0.0023
best reported
actual #184 vs paper #206 22 places worse
paper 0.8810 ±0.0040

Difference within reported uncertainty; not counted as underperformance.

paper 0.8810 ±0.0040 Δ at pub 0.0044
188
AutoSSL
actual #188 vs paper #188
0.8840 ±0.0030
actual #188 vs paper #188
paper 0.8840 ±0.0030

Improvement within reported uncertainty; not highlighted.

paper 0.8840 ±0.0030 Δ at pub 0.0022
210
DGI
actual #210 vs paper #240 30 places worse
0.8740 ±0.0070
actual #210 vs paper #240 30 places worse
paper 0.8740 ±0.0070
paper 0.8740 ±0.0070 Δ at pub 0.0330
213
ParetoGNN
0.8790 ±0.0030
This paper
218
CG3
actual #218 vs paper #218
0.8780 ±0.0090
actual #218 vs paper #218
paper 0.8780 ±0.0090
232
Clu
0.8760 ±0.0060
This paper
252
PairSim
0.8710 ±0.0090
This paper
263
Par
0.8670 ±0.0080
This paper
271
PairDis
0.8650 ±0.0070
This paper
320
MLP
0.8463
#ModelAccuracy ↑Paper
1
GrokFormer
0.9831 ±0.0018
2
PolyFormer
0.9808 ±0.0027
3
SGFormer
0.9796 ±0.0081
9
GCN
0.9774 ±0.0035
58
MLP
0.9597 ±0.0007
63
GCA
actual #63 vs paper #192 129 places worse
0.9590 ±0.0020
best reported
actual #63 vs paper #192 129 places worse
paper 0.9410 ±0.0050
paper 0.9410 ±0.0050 Δ at pub 0.0180
77
GRACE
actual #77 vs paper #174 97 places worse
0.9574 ±0.0006
best reported
actual #77 vs paper #174 97 places worse
paper 0.9450 ±0.0040
paper 0.9450 ±0.0040 Δ at pub 0.0113 Δ today 0.0124
166
WAS
0.9490 ±0.0030
This paper
167
DGI
actual #167 vs paper #201 34 places worse
0.9489 ±0.0009
best reported
actual #167 vs paper #201 34 places worse
paper 0.9390 ±0.0060
168
AGSSL
0.9480 ±0.0030
This paper
180
ParetoGNN
0.9440 ±0.0060
This paper
200
PairDis
0.9400 ±0.0060
This paper
204
AutoSSL
0.9390 ±0.0060
This paper
209
CG3
0.9360 ±0.0060
This paper
218
Clu
0.9350 ±0.0050
This paper
224
PairSim
0.9330 ±0.0030
This paper
231
GRLC
0.9320 ±0.0050
This paper
238
Par
0.9310 ±0.0080
This paper

MoleculeNet

#ModelROC-AUC ↑Paper
1
HIMP
0.8740 ±0.0050
2
GINE w/ VN
0.8720 ±0.0030
3
NaiveGINe+ K=3 w/ VN
0.8700 ±0.0040
14
GCN
0.8400 ±0.0040
31
JOAO
actual #31 vs paper #238 207 places worse
0.8230 ±0.0220
best reported
actual #31 vs paper #238 207 places worse
paper 0.7480 ±0.0060
paper 0.7480 ±0.0060 Δ at pub 0.0750
35
EdgePred
actual #35 vs paper #312 277 places worse
0.8180 ±0.0250
best reported
actual #35 vs paper #312 277 places worse
paper 0.6820 ±0.0910

Difference within reported uncertainty; not counted as underperformance.

paper 0.6820 ±0.0910 Δ at pub 0.1360
46
ContextPred
actual #46 vs paper #283 237 places worse
0.8060 ±0.0120
best reported
actual #46 vs paper #283 237 places worse
paper 0.7290 ±0.0080
paper 0.7290 ±0.0080 Δ at pub 0.0770
47
GraphCL
actual #47 vs paper #228 181 places worse
0.8050 ±0.0170
best reported
actual #47 vs paper #228 181 places worse
paper 0.7510 ±0.0080
paper 0.7510 ±0.0080 Δ at pub 0.0540
61
GraphMVP
actual #61 vs paper #242 181 places worse
0.7990 ±0.0180
best reported
actual #61 vs paper #242 181 places worse
paper 0.7460 ±0.0030
paper 0.7460 ±0.0030 Δ at pub 0.0530
71
GraphLoG
actual #71 vs paper #265 194 places worse
0.7960 ±0.0250
best reported
actual #71 vs paper #265 194 places worse
paper 0.7390 ±0.0140
paper 0.7390 ±0.0140 Δ at pub 0.0570
81
InfoGraph
actual #81 vs paper #263 182 places worse
0.7930
best reported
actual #81 vs paper #263 182 places worse
paper 0.7400 ±0.0050
paper 0.7400 ±0.0050 Δ at pub 0.0530
180
GPT-GNN
actual #180 vs paper #253 73 places worse
0.7610 ±0.0040
best reported
actual #180 vs paper #253 73 places worse
paper 0.7430 ±0.0070
paper 0.7430 ±0.0070 Δ at pub 0.0180
202
GraphMAE
actual #202 vs paper #310 108 places worse
0.7550 ±0.0060
best reported
actual #202 vs paper #310 108 places worse
paper 0.6880 ±0.0050
paper 0.6880 ±0.0050 Δ at pub 0.0670 Δ today 0.0670
209
WAS
0.7540 ±0.0070
This paper
223
R-GCL
0.7520 ±0.0030
This paper
220
G-Contextual
actual #220 vs paper #235 15 places worse
0.7520 ±0.0030
best reported
actual #220 vs paper #235 15 places worse
paper 0.7490 ±0.0020

Difference within reported uncertainty; not counted as underperformance.

paper 0.7490 ±0.0020 Δ at pub 0.0030
229
AttrMask
actual #229 vs paper #247 18 places worse
0.7510 ±0.0090
best reported
actual #229 vs paper #247 18 places worse
paper 0.7440 ±0.0050

Difference within reported uncertainty; not counted as underperformance.

paper 0.7440 ±0.0050 Δ at pub 0.0070
240
AD-GCL
actual #240 vs paper #240
0.7470 ±0.0110
actual #240 vs paper #240
paper 0.7470 ±0.0110

Improvement within reported uncertainty; not highlighted.

paper 0.7470 ±0.0110 Δ at pub 0.0114
257
Random-Select
0.7430 ±0.0060
This paper
256
SimGRACE
actual #256 vs paper #256
0.7430 ±0.0020
actual #256 vs paper #256
paper 0.7430 ±0.0020

Improvement within reported uncertainty; not highlighted.

paper 0.7430 ±0.0020 Δ at pub 0.0010
280
G-Motif
actual #280 vs paper #281 1 place worse
0.7320 ±0.0080
best reported
actual #280 vs paper #281 1 place worse
paper 0.7310 ±0.0040

Difference within reported uncertainty; not counted as underperformance.

paper 0.7310 ±0.0040 Δ at pub 0.0010
314
Average-Weight
0.6780 ±0.0080
This paper
#ModelROC-AUC ↑Paper
1
ProtoMol
0.9140 ±0.0030
2
MMSG
0.9080 ±0.0050
3
MemGNN
0.9070
43
GIN
0.8646 ±0.0081
98
GraphLoG
actual #98 vs paper #214 116 places worse
0.8350 ±0.0120
best reported
actual #98 vs paper #214 116 places worse
paper 0.7810 ±0.0100
paper 0.7810 ±0.0100 Δ at pub 0.0540 Δ today 0.0540
100
JOAO
actual #100 vs paper #257 157 places worse
0.8340 ±0.0330
best reported
actual #100 vs paper #257 157 places worse
paper 0.7340 ±0.0120
paper 0.7340 ±0.0120 Δ at pub 0.1000
105
GraphMAE
actual #105 vs paper #250 145 places worse
0.8310 ±0.0090
best reported
actual #105 vs paper #250 145 places worse
paper 0.7500 ±0.0070
paper 0.7500 ±0.0070 Δ at pub 0.0810 Δ today 0.0810
149
GraphMVP
actual #149 vs paper #171 22 places worse
0.8120 ±0.0090
best reported
actual #149 vs paper #171 22 places worse
paper 0.8030 ±0.0140

Difference within reported uncertainty; not counted as underperformance.

paper 0.8030 ±0.0140 Δ at pub 0.0090 Δ today 0.0090
165
WAS
0.8070 ±0.0050
This paper
176
EdgePred
actual #176 vs paper #292 116 places worse
0.7990 ±0.0090
best reported
actual #176 vs paper #292 116 places worse
paper 0.6610 ±0.0260
paper 0.6610 ±0.0260 Δ at pub 0.1380
182
AttrMask
actual #182 vs paper #226 44 places worse
0.7970 ±0.0033
best reported
actual #182 vs paper #226 44 places worse
paper 0.7740 ±0.0020
186
ContextPred
actual #186 vs paper #226 40 places worse
0.7960 ±0.0120
best reported
actual #186 vs paper #226 40 places worse
paper 0.7730 ±0.0100
paper 0.7730 ±0.0100 Δ at pub 0.0230 Δ today 0.0230
196
G-Contextual
actual #196 vs paper #240 44 places worse
0.7920 ±0.0030
best reported
actual #196 vs paper #240 44 places worse
paper 0.7630 ±0.0190

Difference within reported uncertainty; not counted as underperformance.

paper 0.7630 ±0.0190 Δ at pub 0.0290
202
AD-GCL
actual #202 vs paper #240 38 places worse
0.7630 ±0.0060
actual #202 vs paper #240 38 places worse
paper 0.7630 ±0.0060

Improvement within reported uncertainty; not highlighted.

paper 0.7630 ±0.0060 Δ at pub 0.0128 Δ today 0.0270
204
InfoGraph
actual #204 vs paper #273 69 places worse
0.7890 ±0.0110
best reported
actual #204 vs paper #273 69 places worse
paper 0.7140 ±0.0240
paper 0.7140 ±0.0240 Δ at pub 0.0750
208
GPT-GNN
actual #208 vs paper #208
0.7860 ±0.0290
actual #208 vs paper #208
paper 0.7860 ±0.0290

Improvement within reported uncertainty; not highlighted.

paper 0.7860 ±0.0290 Δ at pub 0.0010
213
GraphCL
actual #213 vs paper #226 13 places worse
0.7820 ±0.0120
best reported
actual #213 vs paper #226 13 places worse
paper 0.7750 ±0.0160

Difference within reported uncertainty; not counted as underperformance.

paper 0.7750 ±0.0160 Δ at pub 0.0070
227
Random-Select
0.7720 ±0.0170
This paper
244
SimGRACE
actual #244 vs paper #244
0.7580 ±0.0040
actual #244 vs paper #244
paper 0.7580 ±0.0040

Improvement within reported uncertainty; not highlighted.

paper 0.7580 ±0.0040 Δ at pub 0.0199
249
Average-Weight
0.7530 ±0.0120
This paper
256
R-GCL
0.7360 ±0.0120
This paper
259
G-Motif
actual #259 vs paper #270 11 places worse
0.7340 ±0.0400
best reported
actual #259 vs paper #270 11 places worse
paper 0.7150 ±0.0090

Difference within reported uncertainty; not counted as underperformance.

paper 0.7150 ±0.0090 Δ at pub 0.0190
#ModelROC-AUC ↑Paper
1
MAGPrompt+
0.9432 ±0.0238
2
CamS-LLaMA
0.9420
3
SE(3)-I MPPH
0.9400 ±0.0210
34
GIN
0.8875 ±0.0049
36
GraphCL
actual #36 vs paper #154 118 places worse
0.8870 ±0.0190
best reported
actual #36 vs paper #154 118 places worse
paper 0.6990 ±0.0160
paper 0.6990 ±0.0160 Δ at pub 0.1880
39
JOAO
actual #39 vs paper #275 236 places worse
0.8790 ±0.0200
best reported
actual #39 vs paper #275 236 places worse
paper 0.6470 ±0.0080
paper 0.6470 ±0.0080 Δ at pub 0.2320
40
ContextPred
actual #40 vs paper #179 139 places worse
0.8770 ±0.0260
best reported
actual #40 vs paper #179 139 places worse
paper 0.6900 ±0.0200
paper 0.6900 ±0.0200 Δ at pub 0.1870
44
EdgePred
actual #44 vs paper #188 144 places worse
0.8730 ±0.0160
best reported
actual #44 vs paper #188 144 places worse
paper 0.6860 ±0.0670
paper 0.6860 ±0.0670 Δ at pub 0.1870
49
GraphMVP
actual #49 vs paper #201 152 places worse
0.8600 ±0.0340
best reported
actual #49 vs paper #201 152 places worse
paper 0.6790 ±0.0100
paper 0.6790 ±0.0100 Δ at pub 0.1810
54
GraphLoG
actual #54 vs paper #245 191 places worse
0.8460 ±0.0080
best reported
actual #54 vs paper #245 191 places worse
paper 0.6640 ±0.0280
paper 0.6640 ±0.0280 Δ at pub 0.1820
101
GraphMAE
actual #101 vs paper #248 147 places worse
0.7200 ±0.0060
best reported
actual #101 vs paper #248 147 places worse
paper 0.6630 ±0.0070
paper 0.6630 ±0.0070 Δ at pub 0.0570 Δ today 0.0570
118
SimGRACE
actual #118 vs paper #240 122 places worse
0.7125 ±0.0086
best reported
actual #118 vs paper #240 122 places worse
paper 0.6670 ±0.0060
paper 0.6670 ±0.0060 Δ at pub 0.0455 Δ today 0.0455
130
WAS
0.7050 ±0.0100
This paper
135
G-Contextual
actual #135 vs paper #282 147 places worse
0.7030 ±0.0160
best reported
actual #135 vs paper #282 147 places worse
paper 0.6400 ±0.0150
paper 0.6400 ±0.0150 Δ at pub 0.0630
136
G-Motif
actual #136 vs paper #136
0.7030 ±0.0150
actual #136 vs paper #136
paper 0.7030 ±0.0150

Improvement within reported uncertainty; not highlighted.

paper 0.7030 ±0.0150 Δ at pub 0.0390
141
AttrMask
actual #141 vs paper #268 127 places worse
0.7020 ±0.0050
best reported
actual #141 vs paper #268 127 places worse
paper 0.6530 ±0.0160
paper 0.6530 ±0.0160 Δ at pub 0.0490 Δ today 0.0490
144
AD-GCL
actual #144 vs paper #144
0.7010 ±0.0120
actual #144 vs paper #144
paper 0.7010 ±0.0120

Improvement within reported uncertainty; not highlighted.

paper 0.7010 ±0.0120 Δ at pub 0.0184
170
R-GCL
0.6930 ±0.0040
This paper
173
InfoGraph
actual #173 vs paper #250 77 places worse
0.6920 ±0.0080
best reported
actual #173 vs paper #250 77 places worse
paper 0.6620 ±0.0110
paper 0.6620 ±0.0110 Δ at pub 0.0300 Δ today 0.0300
220
GPT-GNN
actual #220 vs paper #268 48 places worse
0.6750 ±0.0130
best reported
actual #220 vs paper #268 48 places worse
paper 0.6530 ±0.0150

Difference within reported uncertainty; not counted as underperformance.

paper 0.6530 ±0.0150 Δ at pub 0.0220
227
Random-Select
0.6720 ±0.0050
This paper
242
Average-Weight
0.6660 ±0.0020
This paper
#ModelROC-AUC ↑Paper
1
SE(3)-I MPPH
0.9930 ±0.0040
2
KA-GCN
0.9920 ±0.0050
3
KA-GAT
0.9910 ±0.0050
19
GCN
0.9130 ±0.0170
40
AttrMask
actual #40 vs paper #171 131 places worse
0.8770 ±0.0119
best reported
actual #40 vs paper #171 131 places worse
paper 0.7030 ±0.0750
49
GraphMVP
actual #49 vs paper #118 69 places worse
0.8650 ±0.0170
best reported
actual #49 vs paper #118 69 places worse
paper 0.7640 ±0.0110
71
GraphMAE
actual #71 vs paper #200 129 places worse
0.8230 ±0.0120
best reported
actual #71 vs paper #200 129 places worse
paper 0.6530 ±0.0390
paper 0.6530 ±0.0390 Δ at pub 0.1700 Δ today 0.1700
78
G-Motif
actual #78 vs paper #78
0.8140 ±0.0220
actual #78 vs paper #78
paper 0.8140 ±0.0220

Improvement within reported uncertainty; not highlighted.

paper 0.8140 ±0.0220 Δ at pub 0.0360
79
JOAO
actual #79 vs paper #195 116 places worse
0.8132 ±0.0249
best reported
actual #79 vs paper #195 116 places worse
paper 0.6610 ±0.0370
paper 0.6610 ±0.0370 Δ at pub 0.1522
82
AD-GCL
actual #82 vs paper #105 23 places worse
0.7810 ±0.0360
actual #82 vs paper #105 23 places worse
paper 0.7810 ±0.0360

Improvement within reported uncertainty; not highlighted.

paper 0.7810 ±0.0360 Δ at pub 0.0047
97
GraphCL
actual #97 vs paper #158 61 places worse
0.7890 ±0.0420
best reported
actual #97 vs paper #158 61 places worse
paper 0.7210 ±0.0470

Difference within reported uncertainty; not counted as underperformance.

paper 0.7210 ±0.0470 Δ at pub 0.0680 Δ today 0.0680
99
R-GCL
0.7890 ±0.0410
This paper
103
GraphLoG
actual #103 vs paper #207 104 places worse
0.7872 ±0.0258
best reported
actual #103 vs paper #207 104 places worse
paper 0.6410 ±0.0340
paper 0.6410 ±0.0340 Δ at pub 0.1462 Δ today 0.1462
106
InfoGraph
actual #106 vs paper #164 58 places worse
0.7810
best reported
actual #106 vs paper #164 58 places worse
paper 0.7150 ±0.0630

Difference within reported uncertainty; not counted as underperformance.

paper 0.7150 ±0.0630 Δ at pub 0.0660
115
ContextPred
actual #115 vs paper #194 79 places worse
0.7720 ±0.0088
best reported
actual #115 vs paper #194 79 places worse
paper 0.6690 ±0.0760

Difference within reported uncertainty; not counted as underperformance.

paper 0.6690 ±0.0760 Δ at pub 0.1030 Δ today 0.1030
123
SimGRACE
actual #123 vs paper #194 71 places worse
0.6680 ±0.0200
actual #123 vs paper #194 71 places worse
paper 0.6680 ±0.0200

Improvement within reported uncertainty; not highlighted.

paper 0.6680 ±0.0200 Δ at pub 0.0264 Δ today 0.0880
131
GPT-GNN
actual #131 vs paper #235 104 places worse
0.7490 ±0.0270
best reported
actual #131 vs paper #235 104 places worse
paper 0.5610 ±0.0890
paper 0.5610 ±0.0890 Δ at pub 0.1880
150
WAS
0.7310 ±0.0050
This paper
191
G-Contextual
actual #191 vs paper #191
0.6760 ±0.0290
actual #191 vs paper #191
paper 0.6760 ±0.0290

Improvement within reported uncertainty; not highlighted.

paper 0.6760 ±0.0290 Δ at pub 0.0770
192
EdgePred
actual #192 vs paper #192
0.6730 ±0.0200
actual #192 vs paper #192
paper 0.6730 ±0.0200

Improvement within reported uncertainty; not highlighted.

paper 0.6730 ±0.0200 Δ at pub 0.0320
216
Average-Weight
0.6260 ±0.0440
This paper
230
Random-Select
0.5810 ±0.0150
This paper
#ModelROC-AUC ↑Paper
1
KA-GAT
0.8470 ±0.0020
2
KA-GCN
0.8420 ±0.0010
3
GraphKAN
0.8370 ±0.0010
66
GIN
0.6403 ±0.0104
68
JOAO
actual #68 vs paper #150 82 places worse
0.6400 ±0.0100
best reported
actual #68 vs paper #150 82 places worse
paper 0.6070 ±0.0100
paper 0.6070 ±0.0100 Δ at pub 0.0330
70
GraphMVP
actual #70 vs paper #176 106 places worse
0.6390 ±0.0120
best reported
actual #70 vs paper #176 106 places worse
paper 0.6020 ±0.0160
103
ContextPred
actual #103 vs paper #206 103 places worse
0.6220 ±0.0059
best reported
actual #103 vs paper #206 103 places worse
paper 0.5870 ±0.0160
114
GraphCL
actual #114 vs paper #183 69 places worse
0.6183 ±0.0060
best reported
actual #114 vs paper #183 69 places worse
paper 0.5990 ±0.0150

Difference within reported uncertainty; not counted as underperformance.

paper 0.5990 ±0.0150 Δ at pub 0.0090 Δ today 0.0193
123
GraphLoG
actual #123 vs paper #195 72 places worse
0.6150 ±0.0130
best reported
actual #123 vs paper #195 72 places worse
paper 0.5950 ±0.0240

Difference within reported uncertainty; not counted as underperformance.

paper 0.5950 ±0.0240 Δ at pub 0.0200
134
AttrMask
actual #134 vs paper #232 98 places worse
0.6120 ±0.0012
best reported
actual #134 vs paper #232 98 places worse
paper 0.5510 ±0.0070
139
G-Contextual
actual #139 vs paper #139
0.6110 ±0.0250
actual #139 vs paper #139
paper 0.6110 ±0.0250

Improvement within reported uncertainty; not highlighted.

paper 0.6110 ±0.0250 Δ at pub 0.0270
146
AD-GCL
actual #146 vs paper #195 49 places worse
0.5940 ±0.0070
actual #146 vs paper #195 49 places worse
paper 0.5940 ±0.0070

Improvement within reported uncertainty; not highlighted.

paper 0.5940 ±0.0070 Δ at pub 0.0016 Δ today 0.0140
158
G-Motif
actual #158 vs paper #178 20 places worse
0.6060 ±0.0110
best reported
actual #158 vs paper #178 20 places worse
paper 0.6010 ±0.0170

Difference within reported uncertainty; not counted as underperformance.

paper 0.6010 ±0.0170 Δ at pub 0.0050
156
SimGRACE
actual #156 vs paper #206 50 places worse
0.6060 ±0.0100
best reported
actual #156 vs paper #206 50 places worse
paper 0.5840 ±0.0110
paper 0.5840 ±0.0110 Δ at pub 0.0219 Δ today 0.0220
162
InfoGraph
actual #162 vs paper #212 50 places worse
0.6054 ±0.0090
best reported
actual #162 vs paper #212 50 places worse
paper 0.5820 ±0.0040
paper 0.5820 ±0.0040 Δ at pub 0.0170 Δ today 0.0234
171
WAS
0.6040 ±0.0040
This paper
170
EdgePred
actual #170 vs paper #204 34 places worse
0.6040 ±0.0070
best reported
actual #170 vs paper #204 34 places worse
paper 0.5890 ±0.0130

Difference within reported uncertainty; not counted as underperformance.

paper 0.5890 ±0.0130 Δ at pub 0.0150 Δ today 0.0150
175
GraphMAE
actual #175 vs paper #223 48 places worse
0.6030 ±0.0110
best reported
actual #175 vs paper #223 48 places worse
paper 0.5710 ±0.0070
paper 0.5710 ±0.0070 Δ at pub 0.0320 Δ today 0.0320
184
R-GCL
0.5990 ±0.0090
This paper
197
GPT-GNN
actual #197 vs paper #215 18 places worse
0.5930 ±0.0080
best reported
actual #197 vs paper #215 18 places worse
paper 0.5790 ±0.0020
paper 0.5790 ±0.0020 Δ at pub 0.0140
200
Random-Select
0.5920 ±0.0170
This paper
225
Average-Weight
0.5690 ±0.0150
This paper
#ModelROC-AUC ↑Paper
1
GeomGCL
0.7630
2
LiGhT DeepGPT
0.7570 ±0.0110
3
CoMPT
0.7550
14
GCN
0.7350 ±0.0020
28
ContextPred
actual #28 vs paper #185 157 places worse
0.7140 ±0.0180
best reported
actual #28 vs paper #185 157 places worse
paper 0.6170 ±0.0070
paper 0.6170 ±0.0070 Δ at pub 0.0970
30
EdgePred
actual #30 vs paper #204 174 places worse
0.7120 ±0.0110
best reported
actual #30 vs paper #204 174 places worse
paper 0.5900 ±0.0090
paper 0.5900 ±0.0090 Δ at pub 0.1220
31
JOAO
actual #31 vs paper #178 147 places worse
0.7110 ±0.0140
best reported
actual #31 vs paper #178 147 places worse
paper 0.6240 ±0.0040
paper 0.6240 ±0.0040 Δ at pub 0.0870
35
InfoGraph
actual #35 vs paper #196 161 places worse
0.7050
best reported
actual #35 vs paper #196 161 places worse
paper 0.6070 ±0.0090
paper 0.6070 ±0.0090 Δ at pub 0.0980
42
GraphCL
actual #42 vs paper #167 125 places worse
0.6960 ±0.0230
best reported
actual #42 vs paper #167 125 places worse
paper 0.6280 ±0.0070
paper 0.6280 ±0.0070 Δ at pub 0.0680
50
GraphMVP
actual #50 vs paper #137 87 places worse
0.6890 ±0.0100
best reported
actual #50 vs paper #137 87 places worse
paper 0.6350 ±0.0020
paper 0.6350 ±0.0020 Δ at pub 0.0540
64
GraphLoG
actual #64 vs paper #180 116 places worse
0.6770 ±0.0190
best reported
actual #64 vs paper #180 116 places worse
paper 0.6230 ±0.0060
paper 0.6230 ±0.0060 Δ at pub 0.0540
128
GraphMAE
actual #128 vs paper #186 58 places worse
0.6410 ±0.0030
best reported
actual #128 vs paper #186 58 places worse
paper 0.6150 ±0.0050
paper 0.6150 ±0.0050 Δ at pub 0.0260 Δ today 0.0260
136
WAS
0.6370 ±0.0150
This paper
138
AD-GCL
actual #138 vs paper #167 29 places worse
0.6350 ±0.0070
best reported
actual #138 vs paper #167 29 places worse
paper 0.6280 ±0.0050

Difference within reported uncertainty; not counted as underperformance.

paper 0.6280 ±0.0050 Δ at pub 0.0030 Δ today 0.0070
145
SimGRACE
actual #145 vs paper #182 37 places worse
0.6336 ±0.0052
best reported
actual #145 vs paper #182 37 places worse
paper 0.6210 ±0.0010
paper 0.6210 ±0.0010 Δ at pub 0.0126 Δ today 0.0126
150
AttrMask
actual #150 vs paper #171 21 places worse
0.6330 ±0.0060
best reported
actual #150 vs paper #171 21 places worse
paper 0.6260 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.6260 ±0.0010 Δ at pub 0.0070
151
GPT-GNN
actual #151 vs paper #151
0.6330 ±0.0030
actual #151 vs paper #151
paper 0.6330 ±0.0030

Improvement within reported uncertainty; not highlighted.

paper 0.6330 ±0.0030 Δ at pub 0.0020
172
G-Contextual
actual #172 vs paper #185 13 places worse
0.6260 ±0.0030
best reported
actual #172 vs paper #185 13 places worse
paper 0.6170 ±0.0010
paper 0.6170 ±0.0010 Δ at pub 0.0090
173
G-Motif
actual #173 vs paper #185 12 places worse
0.6260 ±0.0050
best reported
actual #173 vs paper #185 12 places worse
paper 0.6180 ±0.0060

Difference within reported uncertainty; not counted as underperformance.

paper 0.6180 ±0.0060 Δ at pub 0.0080
180
R-GCL
0.6240 ±0.0060
This paper
182
Average-Weight
0.6220 ±0.0180
This paper
203
Random-Select
0.5930 ±0.0070
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere