AAAI 2022

Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminating

Yixin Liu, Yizhen Zheng, Daokun Zhang, Vincent Lee, Shirui Pan

Main figure for Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminating

Abstract

Unsupervised graph representation learning (UGRL) has drawn increasing research attention and achieved promising results in several graph analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth the learned node representations along all edges, ignoring the existence of heterophilic edges that connect nodes with distinct attributes. As a result, current methods are hard to generalize to heterophilic graphs where dissimilar nodes are widely connected, and also vulnerable to adversarial attacks. To address this issue, we propose a novel unsupervised raph epresentation learning method with dge h terophily discrimina ing (GREET) which learns representations by discriminating and leveraging homophilic edges and heterophilic edges. To distinguish two types of edges, we build an edge discriminator that infers edge homophily/heterophily from feature and structure information. We train the edge discriminator in an unsupervised way through minimizing the crafted pivot-anchored ranking loss, with randomly sampled node pairs acting as pivots. Node representations are learned through contrasting the dual-channel encodings obtained from the discriminated homophilic and heterophilic edges. With an effective interplaying scheme, edge discriminating and representation learning can mutually boost each other during the training phase. We conducted extensive experiments on 14 benchmark datasets and multiple learning scenarios to demonstrate the superiority of GREET.

Proposed method: GREET

Benchmark Results

Tested on 12 datasets 81 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
0.9004
44
GAT
actual #44 vs paper #424 380 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #424 380 places worse
paper 0.8300
130
BGRL
actual #130 vs paper #604 474 places worse
0.8730 ±0.0010
best reported
actual #130 vs paper #604 474 places worse
paper 0.8108 ±0.0017
paper 0.8108 ±0.0017 Δ at pub 0.0036 Δ today 0.0622
134
GRACE
actual #134 vs paper #655 521 places worse
0.8720 ±0.0020
best reported
actual #134 vs paper #655 521 places worse
paper 0.8008 ±0.0053
paper 0.8008 ±0.0053 Δ at pub 0.0354 Δ today 0.0712
156
MVGRL
actual #156 vs paper #424 268 places worse
0.8680 ±0.0050
best reported
actual #156 vs paper #424 268 places worse
paper 0.8303 ±0.0027
177
DGI
actual #177 vs paper #498 321 places worse
0.8630 ±0.0020
best reported
actual #177 vs paper #498 321 places worse
paper 0.8229 ±0.0056
218
GMI
actual #218 vs paper #465 247 places worse
0.8526 ±0.0008
best reported
actual #218 vs paper #465 247 places worse
paper 0.8251 ±0.0147
315
GREET
actual #315 vs paper #315
0.8382 ±0.0048
best reported
actual #315 vs paper #315
paper 0.8381 ±0.0087

Difference within reported uncertainty; not counted as underperformance.

paper 0.8381 ±0.0087 Δ today 0.0001
415
GCA
actual #415 vs paper #642 227 places worse
0.8310 ±0.0030
best reported
actual #415 vs paper #642 227 places worse
paper 0.8039 ±0.0042
paper 0.8039 ±0.0042 Δ at pub 0.0271
435
DeepWalk
actual #435 vs paper #822 387 places worse
0.8290
best reported
actual #435 vs paper #822 387 places worse
paper 0.6947 ±0.0055
paper 0.6947 ±0.0055 Δ at pub 0.1343
630
VGAE
actual #630 vs paper #666 36 places worse
0.8059 ±0.0035
best reported
actual #630 vs paper #666 36 places worse
paper 0.7981 ±0.0087
paper 0.7981 ±0.0087 Δ at pub 0.0078
645
Node2Vec
actual #645 vs paper #811 166 places worse
0.8030
best reported
actual #645 vs paper #811 166 places worse
paper 0.7124 ±0.0089
paper 0.7124 ±0.0089 Δ at pub 0.0906
654
GAE
actual #654 vs paper #812 158 places worse
0.8011 ±0.0022
best reported
actual #654 vs paper #812 158 places worse
paper 0.7107 ±0.0039
paper 0.7107 ±0.0039 Δ at pub 0.0904
724
MLP
actual #724 vs paper #888 164 places worse
0.7768
best reported
actual #724 vs paper #888 164 places worse
paper 0.5611 ±0.0034
paper 0.5611 ±0.0034 Δ at pub 0.1864 Δ today 0.2157
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
35
GAT
actual #35 vs paper #388 353 places worse
0.8080 ±0.0026
best reported
actual #35 vs paper #388 353 places worse
paper 0.7250
paper 0.7250 Δ at pub 0.0763 Δ today 0.0830
44
GCN
0.8033 ±0.0088
66
DGI
actual #66 vs paper #513 447 places worse
0.7890 ±0.0020
best reported
actual #66 vs paper #513 447 places worse
paper 0.7149 ±0.0014
73
GMI
actual #73 vs paper #503 430 places worse
0.7869 ±0.0016
best reported
actual #73 vs paper #503 430 places worse
paper 0.7156 ±0.0056
87
MVGRL
actual #87 vs paper #360 273 places worse
0.7808 ±0.0006
best reported
actual #87 vs paper #360 273 places worse
paper 0.7275 ±0.0046
136
BGRL
actual #136 vs paper #501 365 places worse
0.7600 ±0.0020
best reported
actual #136 vs paper #501 365 places worse
paper 0.7159 ±0.0042
paper 0.7159 ±0.0042 Δ at pub 0.0023 Δ today 0.0441
201
GRACE
actual #201 vs paper #517 316 places worse
0.7450 ±0.0010
best reported
actual #201 vs paper #517 316 places worse
paper 0.7141 ±0.0038
paper 0.7141 ±0.0038 Δ at pub 0.0085 Δ today 0.0309
302
GREET
actual #302 vs paper #322 20 places worse
0.7322 ±0.0064
best reported
actual #302 vs paper #322 20 places worse
paper 0.7308 ±0.0084

Difference within reported uncertainty; not counted as underperformance.

paper 0.7308 ±0.0084 Δ today 0.0014
350
MLP
actual #350 vs paper #848 498 places worse
0.7289 ±0.0010
best reported
actual #350 vs paper #848 498 places worse
paper 0.5691 ±0.0042
paper 0.5691 ±0.0042 Δ at pub 0.1267 Δ today 0.1598
505
GCA
actual #505 vs paper #538 33 places worse
0.7150 ±0.0030
best reported
actual #505 vs paper #538 33 places worse
paper 0.7121 ±0.0024

Difference within reported uncertainty; not counted as underperformance.

paper 0.7121 ±0.0024 Δ at pub 0.0012 Δ today 0.0029
625
VGAE
actual #625 vs paper #729 104 places worse
0.6990 ±0.0057
best reported
actual #625 vs paper #729 104 places worse
paper 0.6675 ±0.0037
paper 0.6675 ±0.0037 Δ at pub 0.0315
692
DeepWalk
actual #692 vs paper #838 146 places worse
0.6785 ±0.0079
best reported
actual #692 vs paper #838 146 places worse
paper 0.5882 ±0.0061
paper 0.5882 ±0.0061 Δ at pub 0.0903
739
GAE
actual #739 vs paper #768 29 places worse
0.6639 ±0.0024
best reported
actual #739 vs paper #768 29 places worse
paper 0.6522 ±0.0043
paper 0.6522 ±0.0043 Δ at pub 0.0117
766
Node2Vec
actual #766 vs paper #870 104 places worse
0.6552 ±0.0018
best reported
actual #766 vs paper #870 104 places worse
paper 0.4764 ±0.0077
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
0.9296 ±0.0015
20
GAT
actual #20 vs paper #585 565 places worse
0.9233 ±0.0018
best reported
actual #20 vs paper #585 565 places worse
paper 0.7900
144
BGRL
actual #144 vs paper #458 314 places worse
0.8830 ±0.0010
best reported
actual #144 vs paper #458 314 places worse
paper 0.7997 ±0.0036
paper 0.7997 ±0.0036 Δ at pub 0.0137 Δ today 0.0833
194
GRACE
actual #194 vs paper #437 243 places worse
0.8730 ±0.0010
best reported
actual #194 vs paper #437 243 places worse
paper 0.8015 ±0.0034
paper 0.8015 ±0.0034 Δ at pub 0.0630 Δ today 0.0715
195
GMI
actual #195 vs paper #471 276 places worse
0.8726 ±0.0016
best reported
actual #195 vs paper #471 276 places worse
paper 0.7983 ±0.0090
196
MVGRL
actual #196 vs paper #485 289 places worse
0.8725 ±0.0012
best reported
actual #196 vs paper #485 289 places worse
paper 0.7963 ±0.0038
204
DGI
actual #204 vs paper #715 511 places worse
0.8708 ±0.0017
best reported
actual #204 vs paper #715 511 places worse
paper 0.7743 ±0.0084
210
MLP
actual #210 vs paper #830 620 places worse
0.8690 ±0.0074
best reported
actual #210 vs paper #830 620 places worse
paper 0.7135 ±0.0005
paper 0.7135 ±0.0005 Δ at pub 0.1503 Δ today 0.1555
223
DeepWalk
actual #223 vs paper #838 615 places worse
0.8652 ±0.0012
best reported
actual #223 vs paper #838 615 places worse
paper 0.6987 ±0.0125
251
Node2Vec
actual #251 vs paper #857 606 places worse
0.8520 ±0.0002
best reported
actual #251 vs paper #857 606 places worse
paper 0.6647 ±0.0100
255
GCA
actual #255 vs paper #416 161 places worse
0.8512 ±0.0023
best reported
actual #255 vs paper #416 161 places worse
paper 0.8037 ±0.0075
paper 0.8037 ±0.0075 Δ at pub 0.0091 Δ today 0.0475
299
VGAE
actual #299 vs paper #729 430 places worse
0.8307 ±0.0029
best reported
actual #299 vs paper #729 430 places worse
paper 0.7716 ±0.0031
paper 0.7716 ±0.0031 Δ at pub 0.0417 Δ today 0.0591
304
GAE
actual #304 vs paper #825 521 places worse
0.8294 ±0.0031
best reported
actual #304 vs paper #825 521 places worse
paper 0.7173 ±0.0092
paper 0.7173 ±0.0092 Δ at pub 0.0655 Δ today 0.1121
426
GREET
0.8029 ±0.0100
This paper
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
actual #2 vs paper #265 263 places worse
0.9264 ±0.0042
actual #2 vs paper #265 263 places worse
paper 0.9264 ±0.0042

Improvement within reported uncertainty; not highlighted.

paper 0.9264 ±0.0042 Δ at pub 0.0004 Δ today 0.0405
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
8
GCN
actual #8 vs paper #305 297 places worse
0.9632 ±0.0008
best reported
actual #8 vs paper #305 297 places worse
paper 0.9235 ±0.0025
paper 0.9235 ±0.0025 Δ at pub 0.0007 Δ today 0.0397
132
GREET
actual #132 vs paper #233 101 places worse
0.9361 ±0.0035
best reported
actual #132 vs paper #233 101 places worse
paper 0.9285 ±0.0031
paper 0.9285 ±0.0031 Δ today 0.0076
172
BGRL
actual #172 vs paper #188 16 places worse
0.9337 ±0.0021
best reported
actual #172 vs paper #188 16 places worse
paper 0.9324 ±0.0029

Difference within reported uncertainty; not counted as underperformance.

paper 0.9324 ±0.0029 Δ at pub 0.0013
191
GCA
actual #191 vs paper #244 53 places worse
0.9320 ±0.0060
best reported
actual #191 vs paper #244 53 places worse
paper 0.9278 ±0.0017

Difference within reported uncertainty; not counted as underperformance.

paper 0.9278 ±0.0017 Δ at pub 0.0042 Δ today 0.0042
203
GRACE
actual #203 vs paper #263 60 places worse
0.9313 ±0.0017
best reported
actual #203 vs paper #263 60 places worse
paper 0.9265 ±0.0032
paper 0.9265 ±0.0032 Δ at pub 0.0015 Δ today 0.0048
206
MVGRL
actual #206 vs paper #339 133 places worse
0.9201 ±0.0013
actual #206 vs paper #339 133 places worse
paper 0.9201 ±0.0013
paper 0.9201 ±0.0013 Δ at pub 0.0027 Δ today 0.0109
213
DGI
actual #213 vs paper #375 162 places worse
0.9309 ±0.0008
best reported
actual #213 vs paper #375 162 places worse
paper 0.9149 ±0.0025
317
VGAE
actual #317 vs paper #324 7 places worse
0.9224
best reported
actual #317 vs paper #324 7 places worse
paper 0.9220 ±0.0011

Difference within reported uncertainty; not counted as underperformance.

paper 0.9220 ±0.0011 Δ at pub 0.0004
352
GAE
actual #352 vs paper #366 14 places worse
0.9185 ±0.0006
best reported
actual #352 vs paper #366 14 places worse
paper 0.9162 ±0.0013
paper 0.9162 ±0.0013 Δ at pub 0.0023
390
MLP
actual #390 vs paper #535 145 places worse
0.7854 ±0.0005
actual #390 vs paper #535 145 places worse
paper 0.7854 ±0.0005

Improvement within reported uncertainty; not highlighted.

paper 0.7854 ±0.0005 Δ at pub 0.0004 Δ today 0.1274
408
GMI
actual #408 vs paper #413 5 places worse
0.9072 ±0.0033
actual #408 vs paper #413 5 places worse
paper 0.9072 ±0.0033

Improvement within reported uncertainty; not highlighted.

paper 0.9072 ±0.0033 Δ at pub 0.0002
444
DeepWalk
actual #444 vs paper #464 20 places worse
0.9005 ±0.0008
best reported
actual #444 vs paper #464 20 places worse
paper 0.8944 ±0.0011
paper 0.8944 ±0.0011 Δ at pub 0.0061 Δ today 0.0061
457
Node2Vec
actual #457 vs paper #458 1 place worse
0.8970 ±0.0010
best reported
actual #457 vs paper #458 1 place worse
paper 0.8967 ±0.0012

Difference within reported uncertainty; not counted as underperformance.

paper 0.8967 ±0.0012 Δ at pub 0.0003 Δ today 0.0003
#ModelAccuracy ↑Paper
1
GrokFormer
0.9831 ±0.0018
2
PolyFormer
0.9808 ±0.0027
3
SGFormer
0.9796 ±0.0081
6
GAT
actual #6 vs paper #124 118 places worse
0.9782 ±0.0028
best reported
actual #6 vs paper #124 118 places worse
paper 0.9545 ±0.0017
paper 0.9545 ±0.0017 Δ at pub 0.0075 Δ today 0.0237
9
GCN
actual #9 vs paper #109 100 places worse
0.9774 ±0.0035
best reported
actual #9 vs paper #109 100 places worse
paper 0.9554 ±0.0019
paper 0.9554 ±0.0019 Δ at pub 0.0096 Δ today 0.0220
17
SAGE
0.9739 ±0.0018
52
GREET
0.9613 ±0.0012
This paper
58
MLP
actual #58 vs paper #215 157 places worse
0.9354 ±0.0005
actual #58 vs paper #215 157 places worse
paper 0.9354 ±0.0005

Improvement within reported uncertainty; not highlighted.

paper 0.9354 ±0.0005 Δ at pub 0.0004 Δ today 0.0243
63
GCA
actual #63 vs paper #64 1 place worse
0.9590 ±0.0020
best reported
actual #63 vs paper #64 1 place worse
paper 0.9587 ±0.0015

Difference within reported uncertainty; not counted as underperformance.

paper 0.9587 ±0.0015 Δ at pub 0.0003
69
BGRL
actual #69 vs paper #74 5 places worse
0.9580 ±0.0040
best reported
actual #69 vs paper #74 5 places worse
paper 0.9576 ±0.0038

Difference within reported uncertainty; not counted as underperformance.

paper 0.9576 ±0.0038 Δ at pub 0.0004
77
GRACE
actual #77 vs paper #131 54 places worse
0.9539 ±0.0032
actual #77 vs paper #131 54 places worse
paper 0.9539 ±0.0032

Improvement within reported uncertainty; not highlighted.

paper 0.9539 ±0.0032 Δ at pub 0.0013
114
MVRL
actual #114 vs paper #114
0.9553 ±0.0010
actual #114 vs paper #114
paper 0.9553 ±0.0010
paper 0.9553 ±0.0010 Δ at pub 0.0023
146
GAE
actual #146 vs paper #161 15 places worse
0.9520 ±0.0010
best reported
actual #146 vs paper #161 15 places worse
paper 0.9492 ±0.0007
paper 0.9492 ±0.0007 Δ today 0.0028
163
DeepWalk
actual #163 vs paper #262 99 places worse
0.9490
best reported
actual #163 vs paper #262 99 places worse
paper 0.9177 ±0.0015
paper 0.9177 ±0.0015 Δ at pub 0.0313
167
DGI
actual #167 vs paper #172 5 places worse
0.9457 ±0.0038
actual #167 vs paper #172 5 places worse
paper 0.9457 ±0.0038

Improvement within reported uncertainty; not highlighted.

paper 0.9457 ±0.0038 Δ at pub 0.0006
174
VGAE
0.9452
This paper
268
Node2Vec
actual #268 vs paper #268
0.9120 ±0.0010
best reported
actual #268 vs paper #268
paper 0.9119 ±0.0004

Difference within reported uncertainty; not counted as underperformance.

paper 0.9119 ±0.0004 Δ at pub 0.0001 Δ today 0.0001
#ModelAccuracy ↑Paper
1
DoG
0.9690 ±0.0030
2
GWN-fa
0.9667 ±0.0026
3
GWN-sym
0.9666 ±0.0026
6
GraphSAGE
0.9593 ±0.0025
12
GCN
actual #12 vs paper #63 51 places worse
0.9514 ±0.0025
best reported
actual #12 vs paper #63 51 places worse
paper 0.9310 ±0.0017
best today: Graph Wave Networks (WWW 2025)
paper 0.9310 ±0.0017 Δ at pub 0.0050 Δ today 0.0204
19
GREET
0.9465 ±0.0018
This paper
21
GAT
actual #21 vs paper #103 82 places worse
0.9437 ±0.0028
best reported
actual #21 vs paper #103 82 places worse
paper 0.9241 ±0.0027
best today: Graph Wave Networks (WWW 2025)
paper 0.9241 ±0.0027 Δ at pub 0.0139 Δ today 0.0196
43
DGI
actual #43 vs paper #125 82 places worse
0.9350 ±0.0030
best reported
actual #43 vs paper #125 82 places worse
paper 0.9195 ±0.0040
paper 0.9195 ±0.0040 Δ at pub 0.0025 Δ today 0.0155
51
GCA
actual #51 vs paper #51
0.9332 ±0.0012
actual #51 vs paper #51
paper 0.9332 ±0.0012
paper 0.9332 ±0.0012 Δ at pub 0.0022
53
BGRL
actual #53 vs paper #58 5 places worse
0.9331 ±0.0013
best reported
actual #53 vs paper #58 5 places worse
paper 0.9326 ±0.0036

Difference within reported uncertainty; not counted as underperformance.

paper 0.9326 ±0.0036 Δ at pub 0.0005 Δ today 0.0005
69
GRACE
actual #69 vs paper #92 23 places worse
0.9301 ±0.0003
best reported
actual #69 vs paper #92 23 places worse
paper 0.9278 ±0.0023

Difference within reported uncertainty; not counted as underperformance.

paper 0.9278 ±0.0023 Δ at pub 0.0002 Δ today 0.0023
88
MLP
actual #88 vs paper #157 69 places worse
0.9280 ±0.0020
best reported
actual #88 vs paper #157 69 places worse
paper 0.9042 ±0.0008
paper 0.9042 ±0.0008 Δ at pub 0.0128 Δ today 0.0238
117
VGAE
0.9211 ±0.0009
This paper
116
MVGRL
actual #116 vs paper #125 9 places worse
0.9211 ±0.0012
best reported
actual #116 vs paper #125 9 places worse
paper 0.9197 ±0.0019

Difference within reported uncertainty; not counted as underperformance.

paper 0.9197 ±0.0019 Δ at pub 0.0014 Δ today 0.0014
163
GAE
actual #163 vs paper #163
0.9005 ±0.0035
best reported
actual #163 vs paper #163
paper 0.9001 ±0.0071

Difference within reported uncertainty; not counted as underperformance.

paper 0.9001 ±0.0071 Δ today 0.0004
184
Node2Vec
actual #184 vs paper #184
0.8510
best reported
actual #184 vs paper #184
paper 0.8508 ±0.0003

Difference within reported uncertainty; not counted as underperformance.

paper 0.8508 ±0.0003 Δ at pub 0.0002
188
DeepWalk
0.8461 ±0.0022
This paper

Heterophilic Graphs

#ModelAccuracy ↑Paper
1
P^2GNN
0.9672 ±0.0147
2
DoG
0.9660 ±0.0210
3
GPF-plus
0.9583 ±0.0419
30
GPR-GNN
actual #30 vs paper #182 152 places worse
0.9291 ±0.0132
best reported
actual #30 vs paper #182 152 places worse
paper 0.8324
paper 0.8324 Δ at pub 0.0967
34
MLP
actual #34 vs paper #210 176 places worse
0.9230 ±0.0070
best reported
actual #34 vs paper #210 176 places worse
paper 0.8162
40
H2GCN
actual #40 vs paper #148 108 places worse
0.9189 ±0.0393
best reported
actual #40 vs paper #148 108 places worse
paper 0.8486 ±0.0677
best at pub: Graph-Coupled Oscillator Networks (ICML 2022)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8486 ±0.0677 Δ at pub 0.0004 Δ today 0.0703
53
GraphSAGE
0.9000 ±0.0365
61
FAGCN
actual #61 vs paper #164 103 places worse
0.8432
actual #61 vs paper #164 103 places worse
paper 0.8432

Improvement within reported uncertainty; not highlighted.

paper 0.8432 Δ at pub 0.0189 Δ today 0.0529
101
GREET
0.8703
This paper
211
GAT
actual #211 vs paper #480 269 places worse
0.8162 ±0.0645
best reported
actual #211 vs paper #480 269 places worse
paper 0.6162
257
GCN
actual #257 vs paper #499 242 places worse
0.7933 ±0.0447
best reported
actual #257 vs paper #499 242 places worse
paper 0.6000
best today: Graph Wave Networks (WWW 2025)
paper 0.6000 Δ at pub 0.1840 Δ today 0.1933
304
DGI
actual #304 vs paper #496 192 places worse
0.6059
actual #304 vs paper #496 192 places worse
paper 0.6059

Improvement within reported uncertainty; not highlighted.

paper 0.6059 Δ at pub 0.0206 Δ today 0.1522
351
MVGRL
actual #351 vs paper #470 119 places worse
0.6238
actual #351 vs paper #470 119 places worse
paper 0.6238

Improvement within reported uncertainty; not highlighted.

paper 0.6238 Δ at pub 0.0563 Δ today 0.1063
369
GRACE
actual #369 vs paper #548 179 places worse
0.7215 ±0.0453
best reported
actual #369 vs paper #548 179 places worse
paper 0.5757
409
BGRL
actual #409 vs paper #525 116 places worse
0.5919
actual #409 vs paper #525 116 places worse
paper 0.5919
451
GRACE-FA
0.6405
This paper
515
GCA
0.5946
This paper
523
VGAE
actual #523 vs paper #523
0.5920
actual #523 vs paper #523
paper 0.5920
paper 0.5920 Δ at pub 0.0893
526
GAE
actual #526 vs paper #530 4 places worse
0.5909 ±0.1626
best reported
actual #526 vs paper #530 4 places worse
paper 0.5864

Difference within reported uncertainty; not counted as underperformance.

paper 0.5864 Δ at pub 0.0014 Δ today 0.0045
579
GMI
0.5049
This paper
590
Node2Vec
actual #590 vs paper #606 16 places worse
0.4864 ±0.0292
best reported
actual #590 vs paper #606 16 places worse
paper 0.4192
595
DeepWalk
actual #595 vs paper #597 2 places worse
0.4649
actual #595 vs paper #597 2 places worse
paper 0.4649
paper 0.4649 Δ at pub 0.0418
#ModelAccuracy ↑Paper
1
P^2GNN
0.9541 ±0.0272
2
ACM-GCN
0.9480 ±0.0380
3
RF-GCN
0.9429
11
GPR-GNN
actual #11 vs paper #158 147 places worse
0.9279 ±0.0312
best reported
actual #11 vs paper #158 147 places worse
paper 0.8189
paper 0.8189 Δ at pub 0.0968 Δ today 0.1090
24
MLP
actual #24 vs paper #166 142 places worse
0.9136 ±0.0070
best reported
actual #24 vs paper #166 142 places worse
paper 0.8108 ±0.0793
paper 0.8108 ±0.0793 Δ at pub 0.0378 Δ today 0.1028
38
FAGCN
actual #38 vs paper #163 125 places worse
0.8135
actual #38 vs paper #163 125 places worse
paper 0.8135
68
H2GCN
actual #68 vs paper #151 83 places worse
0.8623 ±0.0471
best reported
actual #68 vs paper #151 83 places worse
paper 0.8216 ±0.0480
best at pub: Graph-Coupled Oscillator Networks (ICML 2022)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8216 ±0.0480 Δ at pub 0.0054 Δ today 0.0407
88
GREET
0.8514
This paper
138
SAGE
0.8269
158
GAT
actual #158 vs paper #380 222 places worse
0.8190 ±0.0540
best reported
actual #158 vs paper #380 222 places worse
paper 0.5946
paper 0.5946 Δ at pub 0.2244
170
GCN
actual #170 vs paper #417 247 places worse
0.8082 ±0.0360
best reported
actual #170 vs paper #417 247 places worse
paper 0.5703 ±0.0330
paper 0.5703 ±0.0330 Δ at pub 0.2217 Δ today 0.2379
306
GRACE-FA
0.6757
This paper
340
MVGRL
actual #340 vs paper #340
0.6430
actual #340 vs paper #340
paper 0.6430
paper 0.6430 Δ at pub 0.1079
350
DGI
actual #350 vs paper #350
0.6335
actual #350 vs paper #350
paper 0.6335
paper 0.6335 Δ at pub 0.1687
354
GAE
actual #354 vs paper #391 37 places worse
0.5885
actual #354 vs paper #391 37 places worse
paper 0.5885

Improvement within reported uncertainty; not highlighted.

paper 0.5885 Δ at pub 0.1345
386
VGAE
actual #386 vs paper #386
0.5919
actual #386 vs paper #386
paper 0.5919

Improvement within reported uncertainty; not highlighted.

paper 0.5919 Δ at pub 0.0987
415
BGRL
actual #415 vs paper #415
0.5730
actual #415 vs paper #415
paper 0.5730
paper 0.5730 Δ at pub 0.0697
423
GRACE
actual #423 vs paper #428 5 places worse
0.5640 ±0.0210
best reported
actual #423 vs paper #428 5 places worse
paper 0.5486

Difference within reported uncertainty; not counted as underperformance.

paper 0.5486 Δ today 0.0154
427
GCA
0.5541
This paper
429
GMI
0.5476
This paper
500
DeepWalk
actual #500 vs paper #555 55 places worse
0.4867 ±0.2784
best reported
actual #500 vs paper #555 55 places worse
paper 0.3918

Difference within reported uncertainty; not counted as underperformance.

paper 0.3918 Δ at pub 0.0237 Δ today 0.0949
542
Node2Vec
actual #542 vs paper #542
0.4294
actual #542 vs paper #542
paper 0.4294

Improvement within reported uncertainty; not highlighted.

paper 0.4294 Δ at pub 0.0240
#ModelAccuracy ↑Paper
1
DiGGR
0.4535 ±0.0353
2
TRIGON
0.4402 ±0.0028
3
DoG
0.4320 ±0.0120
42
MLP
actual #42 vs paper #199 157 places worse
0.4026 ±0.0108
best reported
actual #42 vs paper #199 157 places worse
paper 0.3566 ±0.0094
paper 0.3566 ±0.0094 Δ at pub 0.0452 Δ today 0.0460
53
GPR-GNN
actual #53 vs paper #223 170 places worse
0.3992 ±0.0067
best reported
actual #53 vs paper #223 170 places worse
paper 0.3527 ±0.0104
paper 0.3527 ±0.0104 Δ at pub 0.0464 Δ today 0.0465
56
FAGCN
actual #56 vs paper #197 141 places worse
0.3970
best reported
actual #56 vs paper #197 141 places worse
paper 0.3574 ±0.0062
paper 0.3574 ±0.0062 Δ at pub 0.0396
68
GraphSAGE
0.3899 ±0.0085
71
H2GCN
actual #71 vs paper #192 121 places worse
0.3885 ±0.0117
best reported
actual #71 vs paper #192 121 places worse
paper 0.3586 ±0.0103
paper 0.3586 ±0.0103 Δ at pub 0.0254 Δ today 0.0299
87
Geom-GCN
actual #87 vs paper #305 218 places worse
0.3810
best reported
actual #87 vs paper #305 218 places worse
paper 0.3163
paper 0.3163 Δ at pub 0.0647
135
GCN
actual #135 vs paper #329 194 places worse
0.3690
best reported
actual #135 vs paper #329 194 places worse
paper 0.3083 ±0.0077
paper 0.3083 ±0.0077 Δ at pub 0.0607
158
GREET
0.3655
This paper
182
GAT
actual #182 vs paper #396 214 places worse
0.3605 ±0.0035
best reported
actual #182 vs paper #396 214 places worse
paper 0.2806 ±0.0148
paper 0.2806 ±0.0148 Δ at pub 0.0799
247
MVGRL
actual #247 vs paper #351 104 places worse
0.3464 ±0.0020
best reported
actual #247 vs paper #351 104 places worse
paper 0.3002
paper 0.3002 Δ at pub 0.0207 Δ today 0.0462
251
GRACE
actual #251 vs paper #371 120 places worse
0.2901
actual #251 vs paper #371 120 places worse
paper 0.2901
294
GRACE-FA
0.3255
This paper
309
VGAE
actual #309 vs paper #411 102 places worse
0.3157 ±0.0075
best reported
actual #309 vs paper #411 102 places worse
paper 0.2699
paper 0.2699 Δ at pub 0.0144 Δ today 0.0458
335
DGI
actual #335 vs paper #356 21 places worse
0.2982
actual #335 vs paper #356 21 places worse
paper 0.2982
356
BGRL
actual #356 vs paper #356
0.2986
actual #356 vs paper #356
paper 0.2986
361
GCA
actual #361 vs paper #361
0.2965
actual #361 vs paper #361
paper 0.2965

Improvement within reported uncertainty; not highlighted.

paper 0.2965 Δ at pub 0.0076
383
GAE
actual #383 vs paper #396 13 places worse
0.2803
actual #383 vs paper #396 13 places worse
paper 0.2803
390
Node2Vec
0.2828
This paper
399
GMI
actual #399 vs paper #399
0.2782
actual #399 vs paper #399
paper 0.2782

Improvement within reported uncertainty; not highlighted.

paper 0.2782 Δ at pub 0.0054
424
DeepWalk
actual #424 vs paper #460 36 places worse
0.2550 ±0.0028
best reported
actual #424 vs paper #460 36 places worse
paper 0.2278
paper 0.2278 Δ at pub 0.0272
#ModelAccuracy ↑Paper
1
Hetero-S (GAT 8-layer)
0.8693
2
Dir-GNN+CNA
0.8586 ±0.0180
3
GAT
actual #3 vs paper #157 154 places worse
0.8560
best reported
actual #3 vs paper #157 154 places worse
paper 0.5638 ±0.0219
24
GPR-GNN
actual #24 vs paper #118 94 places worse
0.7830 ±0.0060
best reported
actual #24 vs paper #118 94 places worse
paper 0.6158 ±0.0224
paper 0.6158 ±0.0224 Δ at pub 0.0820 Δ today 0.1672
34
MVGRL
actual #34 vs paper #189 155 places worse
0.7319 ±0.0042
best reported
actual #34 vs paper #189 155 places worse
paper 0.5107
paper 0.5107 Δ at pub 0.0274 Δ today 0.2212
52
GCN
actual #52 vs paper #138 86 places worse
0.7033
best reported
actual #52 vs paper #138 86 places worse
paper 0.5963 ±0.0232
paper 0.5963 ±0.0232 Δ at pub 0.0797 Δ today 0.1070
95
BGRL
actual #95 vs paper #212 117 places worse
0.6486 ±0.0063
best reported
actual #95 vs paper #212 117 places worse
paper 0.4746
paper 0.4746 Δ at pub 0.1740 Δ today 0.1740
105
GCA
actual #105 vs paper #200 95 places worse
0.6366 ±0.0032
best reported
actual #105 vs paper #200 95 places worse
paper 0.4980
paper 0.4980 Δ at pub 0.1114 Δ today 0.1386
106
GREET
0.6364
This paper
107
FAGCN
actual #107 vs paper #107
0.6344 ±0.0205
actual #107 vs paper #107
paper 0.6344 ±0.0205

Improvement within reported uncertainty; not highlighted.

paper 0.6344 ±0.0205 Δ at pub 0.0174
108
SAGE
0.6340 ±0.0300
114
VGAE
actual #114 vs paper #268 154 places worse
0.6232 ±0.0190
best reported
actual #114 vs paper #268 154 places worse
paper 0.3522
paper 0.3522 Δ at pub 0.0743 Δ today 0.2710
119
GRACE
actual #119 vs paper #207 88 places worse
0.6124 ±0.0053
best reported
actual #119 vs paper #207 88 places worse
paper 0.4805
paper 0.4805 Δ at pub 0.1319
124
Geom-GCN
0.6090
This paper
133
H2GCN
actual #133 vs paper #138 5 places worse
0.6030 ±0.0231
best reported
actual #133 vs paper #138 5 places worse
paper 0.5939 ±0.0198

Difference within reported uncertainty; not counted as underperformance.

paper 0.5939 ±0.0198 Δ at pub 0.0091
134
DGI
actual #134 vs paper #254 120 places worse
0.6027 ±0.0070
best reported
actual #134 vs paper #254 120 places worse
paper 0.3995
paper 0.3995 Δ at pub 0.2032 Δ today 0.2032
169
MLP
actual #169 vs paper #215 46 places worse
0.5429
best reported
actual #169 vs paper #215 46 places worse
paper 0.4691 ±0.0215
paper 0.4691 ±0.0215 Δ at pub 0.0129 Δ today 0.0738
175
GMI
actual #175 vs paper #215 40 places worse
0.5281 ±0.0063
best reported
actual #175 vs paper #215 40 places worse
paper 0.4697
paper 0.4697 Δ at pub 0.0584
176
GRACE-FA
0.5268
This paper
209
DeepWalk
actual #209 vs paper #209
0.4774 ±0.0205
actual #209 vs paper #209
paper 0.4774 ±0.0205
paper 0.4774 ±0.0205 Δ at pub 0.0375
246
Node2Vec
0.4193 ±0.0329
This paper
259
GAE
actual #259 vs paper #269 10 places worse
0.3913 ±0.0134
best reported
actual #259 vs paper #269 10 places worse
paper 0.3384
paper 0.3384 Δ at pub 0.0529
#ModelAccuracy ↑Paper
1
IBG-NN
0.7763 ±0.0179
2
Dir-GNN+CNA
0.7747 ±0.0128
3
DHGNN
0.7684 ±0.0161
10
GPR-GNN
actual #10 vs paper #166 156 places worse
0.3965
actual #10 vs paper #166 156 places worse
paper 0.3965
paper 0.3965 Δ at pub 0.1020 Δ today 0.3515
39
H2GCN
actual #39 vs paper #184 145 places worse
0.6190 ±0.0140
best reported
actual #39 vs paper #184 145 places worse
paper 0.3790 ±0.0202
paper 0.3790 ±0.0202 Δ at pub 0.0285 Δ today 0.2400
46
GCN
actual #46 vs paper #203 157 places worse
0.6067
best reported
actual #46 vs paper #203 157 places worse
paper 0.3628
paper 0.3628 Δ at pub 0.1942 Δ today 0.2439
50
MVGRL
actual #50 vs paper #213 163 places worse
0.6009 ±0.0044
best reported
actual #50 vs paper #213 163 places worse
paper 0.3547
paper 0.3547 Δ at pub 0.0328 Δ today 0.2462
67
GAT
actual #67 vs paper #232 165 places worse
0.5630 ±0.0220
best reported
actual #67 vs paper #232 165 places worse
paper 0.3209
paper 0.3209 Δ at pub 0.2421
98
GCA
actual #98 vs paper #212 114 places worse
0.4809 ±0.0021
best reported
actual #98 vs paper #212 114 places worse
paper 0.3550
paper 0.3550 Δ at pub 0.0603 Δ today 0.1259
108
BGRL
actual #108 vs paper #232 124 places worse
0.4624 ±0.0070
best reported
actual #108 vs paper #232 124 places worse
paper 0.3264
120
SAGE
0.4460 ±0.0130
139
FAGCN
actual #139 vs paper #153 14 places worse
0.4259 ±0.0069
best reported
actual #139 vs paper #153 14 places worse
paper 0.4117
141
VGAE
actual #141 vs paper #242 101 places worse
0.4250 ±0.0135
best reported
actual #141 vs paper #242 101 places worse
paper 0.2948
paper 0.2948 Δ at pub 0.0563 Δ today 0.1302
143
GREET
0.4229
This paper
144
DGI
actual #144 vs paper #232 88 places worse
0.4222 ±0.0063
best reported
actual #144 vs paper #232 88 places worse
paper 0.3180
154
GRACE
actual #154 vs paper #236 82 places worse
0.4109 ±0.0085
best reported
actual #154 vs paper #236 82 places worse
paper 0.3133
172
MLP
actual #172 vs paper #242 70 places worse
0.3930 ±0.0079
best reported
actual #172 vs paper #242 70 places worse
paper 0.2928
193
DeepWalk
actual #193 vs paper #231 38 places worse
0.3754 ±0.0219
best reported
actual #193 vs paper #231 38 places worse
paper 0.3293
paper 0.3293 Δ at pub 0.0461
205
GRACE-FA
0.3597
This paper
216
GMI
actual #216 vs paper #240 24 places worse
0.3525 ±0.0121
best reported
actual #216 vs paper #240 24 places worse
paper 0.3011
paper 0.3011 Δ at pub 0.0514
225
GAE
actual #225 vs paper #247 22 places worse
0.3465 ±0.0081
best reported
actual #225 vs paper #247 22 places worse
paper 0.2803
paper 0.2803 Δ at pub 0.0662
271
Node2Vec
0.2284
This paper
#ModelAccuracy ↑Paper
1
DMD++
0.9190 ±0.0260
2
F-GREAD-BS
0.9059 ±0.0380
3
APPNP
0.9010 ±0.0350
22
H2GCN
actual #22 vs paper #34 12 places worse
0.8667 ±0.0469
actual #22 vs paper #34 12 places worse
paper 0.8667 ±0.0469

Improvement within reported uncertainty; not highlighted.

paper 0.8667 ±0.0469 Δ at pub 0.0079
37
MLP
actual #37 vs paper #51 14 places worse
0.8629 ±0.0450
best reported
actual #37 vs paper #51 14 places worse
paper 0.8431

Difference within reported uncertainty; not counted as underperformance.

paper 0.8431 Δ at pub 0.0198
45
GREET
0.8490
This paper
53
GAT
actual #53 vs paper #188 135 places worse
0.8430 ±0.0370
best reported
actual #53 vs paper #188 135 places worse
paper 0.5471
paper 0.5471 Δ at pub 0.2959
56
GPR-GNN
actual #56 vs paper #56
0.8412
actual #56 vs paper #56
paper 0.8412

Improvement within reported uncertainty; not highlighted.

paper 0.8412 Δ at pub 0.0039
60
FAGCN
actual #60 vs paper #60
0.8333
actual #60 vs paper #60
paper 0.8333

Improvement within reported uncertainty; not highlighted.

paper 0.8333 Δ at pub 0.0177
63
GCN
actual #63 vs paper #182 119 places worse
0.8310 ±0.0320
best reported
actual #63 vs paper #182 119 places worse
paper 0.5647
paper 0.5647 Δ at pub 0.2663
69
GraphSAGE
0.8118 ±0.0556
153
GRACE-FA
0.6373
This paper
161
MVGRL
0.6237
This paper
180
VGAE
0.5667
This paper
186
DGI
0.5541
This paper
197
GAE
0.5255
This paper
201
BGRL
0.5235
This paper
208
GCA
0.5078
This paper
211
GRACE
0.5000
This paper
216
GMI
0.4598
This paper
218
Node2Vec
0.3745
This paper
220
DeepWalk
0.3353
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Improved at pub — later paper surpassed this result Best today — OK at publication; today's leaderboard best is elsewhere