Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification

Brown Zaz, M. Catala, Ferran Hernandez Caralt, Moshe Eliasof, Pietro Liò

Main figure for Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification

Abstract

In the transductive setting, where the full graph is observed but node labels are only partially available, progress in semi-supervised node classification has largely focused on architectural innovation. In this paper, we revisit an orthogonal axis: the training objective. We start from a simple observation: transductive models produce predictions for every node during training, including nodes without labels. These unlabeled-node predictions may contain useful training signal, but standard supervised objectives discard them because no ground-truth labels are available. Inspired by the decomposition of cross-entropy into a label-dependent alignment term and a label-independent entropy term, we propose prediction confidence as a natural way to extract this signal in the absence of labels. This motivates Transductive Sharpening (TS): a loss-level modification that minimizes prediction entropy on unlabeled nodes while counterbalancing this effect on labeled nodes. We evaluate Transductive Sharpening across a wide range of node-classification benchmarks and observe consistent performance improvements without requiring any changes to the backbone architecture. Code is available at.

Benchmark Results

Tested on 11 datasets 60 baseline values reported too low Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #220 199 places worse
0.9004
best reported
actual #21 vs paper #220 199 places worse
paper 0.8516 ±0.0036
paper 0.8516 ±0.0036 Δ at pub 0.0488
39
SAGE
actual #39 vs paper #228 189 places worse
0.8911 ±0.0012
best reported
actual #39 vs paper #228 189 places worse
paper 0.8494 ±0.0089
paper 0.8494 ±0.0089 Δ at pub 0.0417
44
GAT
actual #44 vs paper #325 281 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #325 281 places worse
paper 0.8370 ±0.0119
68
NodeFormer
actual #68 vs paper #447 379 places worse
0.8848 ±0.0033
best reported
actual #68 vs paper #447 379 places worse
paper 0.8273 ±0.0075
paper 0.8273 ±0.0075 Δ at pub 0.0575
141
GraphSAGE
0.8708 ±0.0085
175
OGFormer
0.8640 ±0.0030
This paper
186
NormProp
actual #186 vs paper #205 19 places worse
0.8607
best reported
actual #186 vs paper #205 19 places worse
paper 0.8546 ±0.0051

Difference within reported uncertainty; not counted as underperformance.

paper 0.8546 ±0.0051 Δ at pub 0.0061
196
GCN+TS
actual #196 vs paper #196
0.8574 ±0.0054
actual #196 vs paper #196
paper 0.8574 ±0.0054

Improvement within reported uncertainty; not highlighted.

paper 0.8574 ±0.0054 Δ at pub 0.0064
214
SAGE+T
0.8528 ±0.0111
This paper
233
SGFormer
actual #233 vs paper #233
0.8482 ±0.0085
actual #233 vs paper #233
paper 0.8482 ±0.0085

Improvement within reported uncertainty; not highlighted.

paper 0.8482 ±0.0085 Δ at pub 0.0023
244
GAT+T
0.8462 ±0.0089
This paper
277
ELU-GCN
0.8429 ±0.0039
This paper
291
Exphormer
actual #291 vs paper #400 109 places worse
0.8410 ±0.0080
best reported
actual #291 vs paper #400 109 places worse
paper 0.8329 ±0.0136

Difference within reported uncertainty; not counted as underperformance.

paper 0.8329 ±0.0136 Δ at pub 0.0081
314
GraphGPS
actual #314 vs paper #314
0.8387 ±0.0096
actual #314 vs paper #314
paper 0.8387 ±0.0096

Improvement within reported uncertainty; not highlighted.

paper 0.8387 ±0.0096 Δ at pub 0.0092
381
Polynormer
actual #381 vs paper #381
0.8343 ±0.0089
actual #381 vs paper #381
paper 0.8343 ±0.0089

Improvement within reported uncertainty; not highlighted.

paper 0.8343 ±0.0089 Δ at pub 0.0019
401
GOAT
0.8326 ±0.0124
This paper
516
NAGphormer
actual #516 vs paper #612 96 places worse
0.8213 ±0.0118
best reported
actual #516 vs paper #612 96 places worse
paper 0.8092 ±0.0117

Difference within reported uncertainty; not counted as underperformance.

paper 0.8092 ±0.0117 Δ at pub 0.0121
724
MLP
actual #724 vs paper #872 148 places worse
0.7768
best reported
actual #724 vs paper #872 148 places worse
paper 0.6096 ±0.0251
paper 0.6096 ±0.0251 Δ at pub 0.1672
866
MLP+TS
0.6448 ±0.0283
This paper
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
7
NodeFormer
actual #7 vs paper #500 493 places worse
0.9490 ±0.0019
best reported
actual #7 vs paper #500 493 places worse
paper 0.7959 ±0.0092
18
GCN
actual #18 vs paper #380 362 places worse
0.9296 ±0.0015
best reported
actual #18 vs paper #380 362 places worse
paper 0.8088 ±0.0031
20
GAT
actual #20 vs paper #474 454 places worse
0.9233 ±0.0018
best reported
actual #20 vs paper #474 454 places worse
paper 0.7980 ±0.0093
53
Polynormer
actual #53 vs paper #541 488 places worse
0.9044 ±0.0021
best reported
actual #53 vs paper #541 488 places worse
paper 0.7935 ±0.0073
paper 0.7935 ±0.0073 Δ at pub 0.1109
56
SGFormer
actual #56 vs paper #398 342 places worse
0.9037 ±0.0020
best reported
actual #56 vs paper #398 342 places worse
paper 0.8060 ±0.0049
paper 0.8060 ±0.0049 Δ at pub 0.0977
91
NAGphormer
actual #91 vs paper #437 346 places worse
0.8939 ±0.0013
best reported
actual #91 vs paper #437 346 places worse
paper 0.8014 ±0.0106
paper 0.8014 ±0.0106 Δ at pub 0.0925
99
GOAT
actual #99 vs paper #445 346 places worse
0.8915 ±0.0039
best reported
actual #99 vs paper #445 346 places worse
paper 0.8006 ±0.0067
paper 0.8006 ±0.0067 Δ at pub 0.0909
105
Exphormer
actual #105 vs paper #484 379 places worse
0.8906 ±0.0024
best reported
actual #105 vs paper #484 379 places worse
paper 0.7967 ±0.0073
paper 0.7967 ±0.0073 Δ at pub 0.0939
116
SAGE
actual #116 vs paper #646 530 places worse
0.8881 ±0.0015
best reported
actual #116 vs paper #646 530 places worse
paper 0.7840 ±0.0112
paper 0.7840 ±0.0112 Δ at pub 0.1041
125
GraphSAGE
0.8864 ±0.0030
172
GraphGPS
actual #172 vs paper #458 286 places worse
0.8772 ±0.0030
best reported
actual #172 vs paper #458 286 places worse
paper 0.7994 ±0.0026
paper 0.7994 ±0.0026 Δ at pub 0.0778
210
MLP
actual #210 vs paper #846 636 places worse
0.8690 ±0.0074
best reported
actual #210 vs paper #846 636 places worse
paper 0.6896 ±0.0116
paper 0.6896 ±0.0116 Δ at pub 0.1794
343
NormProp
actual #343 vs paper #393 50 places worse
0.8153 ±0.0001
best reported
actual #343 vs paper #393 50 places worse
paper 0.8072 ±0.0109

Difference within reported uncertainty; not counted as underperformance.

paper 0.8072 ±0.0109 Δ at pub 0.0081
348
OGFormer
0.8150 ±0.0050
This paper
392
GCN+TS
actual #392 vs paper #392
0.8074 ±0.0030
actual #392 vs paper #392
paper 0.8074 ±0.0030

Improvement within reported uncertainty; not highlighted.

paper 0.8074 ±0.0030 Δ at pub 0.0004
403
ELU-GCN
0.8051 ±0.0021
This paper
482
SAGE+T
0.7972 ±0.0069
This paper
611
GAT+T
0.7884 ±0.0067
This paper
822
MLP+TS
0.7230 ±0.0189
This paper
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
This paper
2
GAT
actual #2 vs paper #2
0.9669 ±0.0014
actual #2 vs paper #2
paper 0.9669 ±0.0014
paper 0.9669 ±0.0014 Δ at pub 0.0171
3
GAT+T
0.9660 ±0.0007
This paper
4
Polynormer
actual #4 vs paper #4
0.9657 ±0.0023
actual #4 vs paper #4
paper 0.9657 ±0.0023
paper 0.9657 ±0.0023 Δ at pub 0.0046
5
SAGE+T
0.9651 ±0.0023
This paper
7
SAGE
actual #7 vs paper #7
0.9643 ±0.0027
actual #7 vs paper #7
paper 0.9643 ±0.0027
8
GCN
actual #8 vs paper #8
0.9632 ±0.0008
actual #8 vs paper #8
paper 0.9632 ±0.0008
paper 0.9632 ±0.0008 Δ at pub 0.0156
9
GCN+TS
0.9621 ±0.0011
This paper
11
NAGphormer
actual #11 vs paper #11
0.9614 ±0.0016
actual #11 vs paper #11
paper 0.9614 ±0.0016

Improvement within reported uncertainty; not highlighted.

paper 0.9614 ±0.0016 Δ at pub 0.0020
23
Exphormer
actual #23 vs paper #23
0.9569 ±0.0039
actual #23 vs paper #23
paper 0.9569 ±0.0039
prev best: Even Sparser Graph Transformers (NeurIPS 2024)

Improvement within reported uncertainty; not highlighted.

paper 0.9569 ±0.0039 Δ at pub 0.0033
29
SGFormer
actual #29 vs paper #29
0.9558 ±0.0036
actual #29 vs paper #29
paper 0.9558 ±0.0036
32
OGFormer
0.9550
This paper
44
NodeFormer
actual #44 vs paper #158 114 places worse
0.9527 ±0.0022
best reported
actual #44 vs paper #158 114 places worse
paper 0.9343 ±0.0056
paper 0.9343 ±0.0056 Δ at pub 0.0184 Δ today 0.0184
56
GraphSAGE
0.9508 ±0.0026
57
GraphGPS
actual #57 vs paper #65 8 places worse
0.9506 ±0.0013
best reported
actual #57 vs paper #65 8 places worse
paper 0.9489 ±0.0014

Difference within reported uncertainty; not counted as underperformance.

paper 0.9489 ±0.0014 Δ at pub 0.0017 Δ today 0.0017
86
GOAT
actual #86 vs paper #86
0.9433 ±0.0021
actual #86 vs paper #86
paper 0.9433 ±0.0021

Improvement within reported uncertainty; not highlighted.

paper 0.9433 ±0.0021 Δ at pub 0.0137
390
MLP
actual #390 vs paper #494 104 places worse
0.9128 ±0.0063
best reported
actual #390 vs paper #494 104 places worse
paper 0.8757 ±0.0052
paper 0.8757 ±0.0052 Δ at pub 0.0371
492
MLP+TS
0.8765 ±0.0022
This paper
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9461 ±0.0017
This paper
2
GCN
actual #2 vs paper #2
0.9412 ±0.0008
actual #2 vs paper #2
paper 0.9412 ±0.0008

Improvement within reported uncertainty; not highlighted.

paper 0.9412 ±0.0008 Δ at pub 0.0252
3
GAT
actual #3 vs paper #3
0.9398 ±0.0022
actual #3 vs paper #3
paper 0.9398 ±0.0022

Improvement within reported uncertainty; not highlighted.

paper 0.9398 ±0.0022 Δ at pub 0.0158
4
GCN+TS
0.9398 ±0.0026
This paper
5
GAT+T
0.9386 ±0.0013
This paper
6
Polynormer
actual #6 vs paper #6
0.9378 ±0.0010
actual #6 vs paper #6
paper 0.9378 ±0.0010
paper 0.9378 ±0.0010 Δ at pub 0.0060
8
SAGE
actual #8 vs paper #8
0.9351 ±0.0006
actual #8 vs paper #8
paper 0.9351 ±0.0006
paper 0.9351 ±0.0006 Δ at pub 0.0299
9
SAGE+T
0.9343 ±0.0011
This paper
12
OGFormer
0.9290 ±0.0030
This paper
18
SGFormer
actual #18 vs paper #18
0.9242 ±0.0066
actual #18 vs paper #18
paper 0.9242 ±0.0066
20
GOAT
actual #20 vs paper #20
0.9229 ±0.0037
actual #20 vs paper #20
paper 0.9229 ±0.0037
paper 0.9229 ±0.0037 Δ at pub 0.0133
33
Exphormer
actual #33 vs paper #33
0.9180 ±0.0035
actual #33 vs paper #33
paper 0.9180 ±0.0035

Improvement within reported uncertainty; not highlighted.

paper 0.9180 ±0.0035 Δ at pub 0.0020
34
GraphGPS
actual #34 vs paper #34
0.9179 ±0.0063
actual #34 vs paper #34
paper 0.9179 ±0.0063

Improvement within reported uncertainty; not highlighted.

paper 0.9179 ±0.0063 Δ at pub 0.0060
38
NAGphormer
actual #38 vs paper #38
0.9169 ±0.0030
actual #38 vs paper #38
paper 0.9169 ±0.0030
paper 0.9169 ±0.0030 Δ at pub 0.0047
46
GraphSAGE
0.9120 ±0.0029
48
NodeFormer
actual #48 vs paper #244 196 places worse
0.9112 ±0.0043
best reported
actual #48 vs paper #244 196 places worse
paper 0.8729 ±0.0058
paper 0.8729 ±0.0058 Δ at pub 0.0383
320
MLP
actual #320 vs paper #390 70 places worse
0.8463
best reported
actual #320 vs paper #390 70 places worse
paper 0.8246 ±0.0045
387
MLP+TS
0.8287 ±0.0056
This paper
#ModelAccuracy ↑Paper
1
GrokFormer
0.9831 ±0.0018
2
PolyFormer
0.9808 ±0.0027
3
SGFormer
actual #3 vs paper #35 32 places worse
0.9796 ±0.0081
best reported
actual #3 vs paper #35 32 places worse
paper 0.9675 ±0.0026

Difference within reported uncertainty; not counted as underperformance.

paper 0.9675 ±0.0026 Δ at pub 0.0121
5
NAGphormer
actual #5 vs paper #20 15 places worse
0.9785 ±0.0026
best reported
actual #5 vs paper #20 15 places worse
paper 0.9735 ±0.0012
paper 0.9735 ±0.0012 Δ at pub 0.0050
6
GAT
actual #6 vs paper #20 14 places worse
0.9782 ±0.0028
best reported
actual #6 vs paper #20 14 places worse
paper 0.9732 ±0.0006
paper 0.9732 ±0.0006 Δ at pub 0.0050
9
GCN
actual #9 vs paper #15 6 places worse
0.9774 ±0.0035
best reported
actual #9 vs paper #15 6 places worse
paper 0.9744 ±0.0014

Difference within reported uncertainty; not counted as underperformance.

paper 0.9744 ±0.0014 Δ at pub 0.0030
13
GraphGPS
actual #13 vs paper #36 23 places worse
0.9760 ±0.0005
best reported
actual #13 vs paper #36 23 places worse
paper 0.9671 ±0.0015
paper 0.9671 ±0.0015 Δ at pub 0.0089
16
GCN+TS
0.9744 ±0.0014
This paper
17
SAGE
actual #17 vs paper #23 6 places worse
0.9739 ±0.0018
best reported
actual #17 vs paper #23 6 places worse
paper 0.9725 ±0.0008

Difference within reported uncertainty; not counted as underperformance.

paper 0.9725 ±0.0008 Δ at pub 0.0014
18
GraphTARIF
0.9739 ±0.0007
This paper
23
GAT+T
0.9726 ±0.0003
This paper
25
SAGE+T
0.9723
This paper
26
Polynormer
actual #26 vs paper #27 1 place worse
0.9722 ±0.0006
best reported
actual #26 vs paper #27 1 place worse
paper 0.9718 ±0.0011

Difference within reported uncertainty; not counted as underperformance.

paper 0.9718 ±0.0011 Δ at pub 0.0004
27
Exphormer
actual #27 vs paper #31 4 places worse
0.9720 ±0.0010
best reported
actual #27 vs paper #31 4 places worse
paper 0.9706 ±0.0013

Difference within reported uncertainty; not counted as underperformance.

paper 0.9706 ±0.0013 Δ at pub 0.0014
34
NodeFormer
actual #34 vs paper #43 9 places worse
0.9680 ±0.0063
best reported
actual #34 vs paper #43 9 places worse
paper 0.9648 ±0.0034

Difference within reported uncertainty; not counted as underperformance.

paper 0.9648 ±0.0034 Δ at pub 0.0032
43
GraphSAGE
0.9649 ±0.0006
44
GOAT
actual #44 vs paper #44
0.9647 ±0.0016
actual #44 vs paper #44
paper 0.9647 ±0.0016

Improvement within reported uncertainty; not highlighted.

paper 0.9647 ±0.0016 Δ at pub 0.0020
57
MLP+TS
0.9598 ±0.0008
This paper
58
MLP
actual #58 vs paper #58
0.9597 ±0.0007
actual #58 vs paper #58
paper 0.9597 ±0.0007

Improvement within reported uncertainty; not highlighted.

paper 0.9597 ±0.0007 Δ at pub 0.0034
#ModelAccuracy ↑Paper
1
GCN
actual #1 vs paper #91 90 places worse
0.9302 ±0.0011
best reported
actual #1 vs paper #91 90 places worse
paper 0.8017 ±0.0048
paper 0.8017 ±0.0048 Δ at pub 0.1285
2
RSE + RGCN (70b)
0.8852 ±0.0019
3
LEMP+T
0.8825
5
SAGE+T
actual #5 vs paper #73 68 places worse
0.8823
best reported
actual #5 vs paper #73 68 places worse
paper 0.8110 ±0.0032
paper 0.8110 ±0.0032 Δ at pub 0.0713
9
SAGE
actual #9 vs paper #78 69 places worse
0.8771
best reported
actual #9 vs paper #78 69 places worse
paper 0.8077 ±0.0014
paper 0.8077 ±0.0014 Δ at pub 0.0694
31
GAT
actual #31 vs paper #73 42 places worse
0.8533
best reported
actual #31 vs paper #73 42 places worse
paper 0.8103 ±0.0092
paper 0.8103 ±0.0092 Δ at pub 0.0430
48
NAGphormer
actual #48 vs paper #176 128 places worse
0.8341 ±0.0034
best reported
actual #48 vs paper #176 128 places worse
paper 0.7792 ±0.0093
paper 0.7792 ±0.0093 Δ at pub 0.0549
54
GIN
0.8303 ±0.0021
57
SGFormer
actual #57 vs paper #97 40 places worse
0.8271 ±0.0056
best reported
actual #57 vs paper #97 40 places worse
paper 0.8005 ±0.0046
paper 0.8005 ±0.0046 Δ at pub 0.0266
74
NodeFormer
actual #74 vs paper #230 156 places worse
0.8103 ±0.0094
best reported
actual #74 vs paper #230 156 places worse
paper 0.7513 ±0.0093
paper 0.7513 ±0.0093 Δ at pub 0.0590
77
GraphTARIF
0.8093 ±0.0057
This paper
88
GCN+TS
0.8031 ±0.0044
This paper
90
Polynormer
actual #90 vs paper #90
0.8026 ±0.0092
actual #90 vs paper #90
paper 0.8026 ±0.0092

Improvement within reported uncertainty; not highlighted.

paper 0.8026 ±0.0092 Δ at pub 0.0073
117
Exphormer
actual #117 vs paper #117
0.7938 ±0.0062
actual #117 vs paper #117
paper 0.7938 ±0.0062

Improvement within reported uncertainty; not highlighted.

paper 0.7938 ±0.0062 Δ at pub 0.0084
120
GraphGPS
actual #120 vs paper #150 30 places worse
0.7926 ±0.0057
best reported
actual #120 vs paper #150 30 places worse
paper 0.7866 ±0.0049

Difference within reported uncertainty; not counted as underperformance.

paper 0.7866 ±0.0049 Δ at pub 0.0060
176
GOAT
actual #176 vs paper #176
0.7796 ±0.0063
actual #176 vs paper #176
paper 0.7796 ±0.0063
paper 0.7796 ±0.0063 Δ at pub 0.0096
237
MLP
actual #237 vs paper #262 25 places worse
0.7469 ±0.0085
best reported
actual #237 vs paper #262 25 places worse
paper 0.7096 ±0.0100
paper 0.7096 ±0.0100 Δ at pub 0.0373
249
MLP+TS
0.7248 ±0.0083
This paper

Heterophilic Graphs

#ModelAccuracy ↑Paper
1
Hetero-S (GAT 8-layer)
0.8693
2
Dir-GNN+CNA
0.8586 ±0.0180
3
GAT
actual #3 vs paper #229 226 places worse
0.8560
best reported
actual #3 vs paper #229 226 places worse
paper 0.4387 ±0.0520
paper 0.4387 ±0.0520 Δ at pub 0.4173
25
FSGNN
actual #25 vs paper #251 226 places worse
0.7827 ±0.0128
best reported
actual #25 vs paper #251 226 places worse
paper 0.4061 ±0.0297
paper 0.4061 ±0.0297 Δ at pub 0.3766 Δ today 0.3766
45
GloGNN
actual #45 vs paper #282 237 places worse
0.7133 ±0.0242
best reported
actual #45 vs paper #282 237 places worse
paper 0.2590 ±0.0358
paper 0.2590 ±0.0358 Δ at pub 0.4543
52
GCN
actual #52 vs paper #224 172 places worse
0.7033
best reported
actual #52 vs paper #224 172 places worse
paper 0.4530 ±0.0230
paper 0.4530 ±0.0230 Δ at pub 0.2503
72
GPRGNN
actual #72 vs paper #254 182 places worse
0.6748 ±0.0040
best reported
actual #72 vs paper #254 182 places worse
paper 0.3993 ±0.0330
paper 0.3993 ±0.0330 Δ at pub 0.2755
108
SAGE
actual #108 vs paper #229 121 places worse
0.6340 ±0.0300
best reported
actual #108 vs paper #229 121 places worse
paper 0.4432 ±0.0455
paper 0.4432 ±0.0455 Δ at pub 0.1908
115
GraphSAGE
0.6215 ±0.0042
133
H2GCN
actual #133 vs paper #279 146 places worse
0.6030 ±0.0231
best reported
actual #133 vs paper #279 146 places worse
paper 0.2675 ±0.0364
paper 0.2675 ±0.0364 Δ at pub 0.3355
138
Polynormer
actual #138 vs paper #245 107 places worse
0.6000 ±0.0180
best reported
actual #138 vs paper #245 107 places worse
paper 0.4197 ±0.0318
paper 0.4197 ±0.0318 Δ at pub 0.1803
159
GraphGPS
actual #159 vs paper #246 87 places worse
0.5620 ±0.0380
best reported
actual #159 vs paper #246 87 places worse
paper 0.4155 ±0.0391
paper 0.4155 ±0.0391 Δ at pub 0.1465
169
MLP
actual #169 vs paper #229 60 places worse
0.5429
best reported
actual #169 vs paper #229 60 places worse
paper 0.4386 ±0.0523
paper 0.4386 ±0.0523 Δ at pub 0.1043
188
SGFormer
actual #188 vs paper #225 37 places worse
0.5140 ±0.0170
best reported
actual #188 vs paper #225 37 places worse
paper 0.4521 ±0.0372
paper 0.4521 ±0.0372 Δ at pub 0.0619
212
GCN+ReP
0.4757 ±0.0390
This paper
213
CoED
0.4727 ±0.0362
This paper
215
M3Dphormer
0.4709 ±0.0405
This paper
225
GCN+TS
0.4527 ±0.0474
This paper
228
GAT+T
0.4452 ±0.0369
This paper
230
MLP+TS
0.4386 ±0.0523
This paper
237
SAGE+T
0.4332 ±0.0467
This paper
267
NodeFormer
actual #267 vs paper #267
0.3638 ±0.0385
actual #267 vs paper #267
paper 0.3638 ±0.0385

Improvement within reported uncertainty; not highlighted.

paper 0.3638 ±0.0385 Δ at pub 0.0146
270
CPGNN
0.3300 ±0.0315
This paper
#ModelAccuracy ↑Paper
1
IBG-NN
0.7763 ±0.0179
2
Dir-GNN+CNA
0.7747 ±0.0128
3
DHGNN
0.7684 ±0.0161
11
FSGNN
actual #11 vs paper #205 194 places worse
0.7416
best reported
actual #11 vs paper #205 194 places worse
paper 0.3592 ±0.0132
paper 0.3592 ±0.0132 Δ at pub 0.3824
19
GloGNN
actual #19 vs paper #217 198 places worse
0.7121 ±0.0184
best reported
actual #19 vs paper #217 198 places worse
paper 0.3511 ±0.0124
paper 0.3511 ±0.0124 Δ at pub 0.3610
39
H2GCN
actual #39 vs paper #217 178 places worse
0.6190 ±0.0140
best reported
actual #39 vs paper #217 178 places worse
paper 0.3510 ±0.0115
paper 0.3510 ±0.0115 Δ at pub 0.2680
46
GCN
actual #46 vs paper #124 78 places worse
0.6067
best reported
actual #46 vs paper #124 78 places worse
paper 0.4425 ±0.0204
paper 0.4425 ±0.0204 Δ at pub 0.1642
61
GraphGPS
actual #61 vs paper #166 105 places worse
0.5690 ±0.0300
best reported
actual #61 vs paper #166 105 places worse
paper 0.3981 ±0.0228
paper 0.3981 ±0.0228 Δ at pub 0.1709
67
GAT
actual #67 vs paper #150 83 places worse
0.5630 ±0.0220
best reported
actual #67 vs paper #150 83 places worse
paper 0.4151 ±0.0234
paper 0.4151 ±0.0234 Δ at pub 0.1479
76
GPRGNN
actual #76 vs paper #173 97 places worse
0.5435 ±0.0087
best reported
actual #76 vs paper #173 97 places worse
paper 0.3895 ±0.0199
paper 0.3895 ±0.0199 Δ at pub 0.1540
110
GCN+ReP
0.4589 ±0.0145
This paper
113
GraphTARIF
0.4558 ±0.0191
This paper
114
CoED
0.4550 ±0.0162
This paper
120
SAGE
actual #120 vs paper #160 40 places worse
0.4460 ±0.0130
best reported
actual #120 vs paper #160 40 places worse
paper 0.4048 ±0.0290

Difference within reported uncertainty; not counted as underperformance.

paper 0.4048 ±0.0290 Δ at pub 0.0412
121
GCN+TS
0.4457 ±0.0204
This paper
123
M3Dphormer
0.4434 ±0.0194
This paper
128
GraphSAGE
0.4378 ±0.0190
138
SGFormer
actual #138 vs paper #138
0.4265 ±0.0241
actual #138 vs paper #138
paper 0.4265 ±0.0241
paper 0.4265 ±0.0241 Δ at pub 0.0684
146
Polynormer
actual #146 vs paper #146
0.4197 ±0.0214
actual #146 vs paper #146
paper 0.4197 ±0.0214
paper 0.4197 ±0.0214 Δ at pub 0.0347
151
SAGE+T
0.4132 ±0.0235
This paper
162
GAT+T
0.4036 ±0.0166
This paper
171
MLP+TS
0.3939 ±0.0091
This paper
172
MLP
actual #172 vs paper #172
0.3930 ±0.0079
actual #172 vs paper #172
paper 0.3930 ±0.0079
paper 0.3930 ±0.0079 Δ at pub 0.0267
175
NodeFormer
actual #175 vs paper #175
0.3889 ±0.0267
actual #175 vs paper #175
paper 0.3889 ±0.0267

Improvement within reported uncertainty; not highlighted.

paper 0.3889 ±0.0267 Δ at pub 0.0037
241
CPGNN
0.3004 ±0.0203
This paper

Heterophily Benchmark

#ModelAccuracy ↑Paper
1
Dir-Poly
0.9451 ±0.0022
This paper
2
D-CDE
0.9387 ±0.0041
3
LargeScaleNet
0.9358 ±0.0024
5
GraphTARIF
0.9323 ±0.0038
This paper
7
Polynormer
actual #7 vs paper #7
0.9266 ±0.0060
actual #7 vs paper #7
paper 0.9266 ±0.0060

Improvement within reported uncertainty; not highlighted.

paper 0.9266 ±0.0060 Δ at pub 0.0011
11
CoED
0.9217 ±0.0029
This paper
15
BuNN
0.9175 ±0.0039
This paper
16
GCN+TS
0.9166 ±0.0020
This paper
23
SAGE+T
0.9127 ±0.0036
This paper
26
GraphSAGE
0.9106 ±0.0027
27
GAT+T
0.9093 ±0.0020
This paper
61
GCN+ReP
0.8643 ±0.0074
This paper
64
SAGE
actual #64 vs paper #179 115 places worse
0.8574 ±0.0067
best reported
actual #64 vs paper #179 115 places worse
paper 0.5569 ±0.0023
paper 0.5569 ±0.0023 Δ at pub 0.3005 Δ today 0.3005
77
GCN
actual #77 vs paper #180 103 places worse
0.8272 ±0.0082
best reported
actual #77 vs paper #180 103 places worse
paper 0.5411 ±0.0034
paper 0.5411 ±0.0034 Δ at pub 0.2861
78
GraphGPS
0.8272 ±0.0068
This paper
83
GAT
actual #83 vs paper #179 96 places worse
0.8145 ±0.0009
best reported
actual #83 vs paper #179 96 places worse
paper 0.5559 ±0.0027
paper 0.5559 ±0.0027 Δ at pub 0.2586
90
SGFormer
actual #90 vs paper #90
0.8001 ±0.0044
actual #90 vs paper #90
paper 0.8001 ±0.0044
paper 0.8001 ±0.0044 Δ at pub 0.1462
92
FSGNN
0.7992 ±0.0056
This paper
109
NodeFormer
actual #109 vs paper #109
0.7483 ±0.0081
actual #109 vs paper #109
paper 0.7483 ±0.0081
paper 0.7483 ±0.0081 Δ at pub 0.1034
129
H2GCN
actual #129 vs paper #164 35 places worse
0.6809 ±0.0029
best reported
actual #129 vs paper #164 35 places worse
paper 0.6011 ±0.0052
paper 0.6011 ±0.0052 Δ at pub 0.0798 Δ today 0.0798
133
GPRGNN
actual #133 vs paper #144 11 places worse
0.6704 ±0.0092
best reported
actual #133 vs paper #144 11 places worse
paper 0.6485 ±0.0027
paper 0.6485 ±0.0027 Δ at pub 0.0219
135
MLP
actual #135 vs paper #138 3 places worse
0.6665 ±0.0047
best reported
actual #135 vs paper #138 3 places worse
paper 0.6610 ±0.0044

Difference within reported uncertainty; not counted as underperformance.

paper 0.6610 ±0.0044 Δ at pub 0.0055
138
MLP+TS
0.6612 ±0.0029
This paper
152
CPGNN
0.6396 ±0.0062
This paper
154
GloGNN
actual #154 vs paper #167 13 places worse
0.6385 ±0.0049
best reported
actual #154 vs paper #167 13 places worse
paper 0.5963 ±0.0069
paper 0.5963 ±0.0069 Δ at pub 0.0422 Δ today 0.0422
#ModelAccuracy ↑Paper
1
UniGAP
0.6375 ±0.0110
2
H2GCN + HalfHop
0.5961 ±0.0100
3
GraphSAGE + HalfHop
0.5897 ±0.0150
7
H2GCN
actual #7 vs paper #196 189 places worse
0.5681 ±0.0090
best reported
actual #7 vs paper #196 189 places worse
paper 0.3647 ±0.0023
8
SAGE+T
0.5672 ±0.0035
This paper
9
GraphTARIF
0.5586 ±0.0042
This paper
11
GAT+T
0.5573 ±0.0031
This paper
12
SAGE
actual #12 vs paper #12
0.5569 ±0.0023
actual #12 vs paper #12
paper 0.5569 ±0.0023
paper 0.5569 ±0.0023 Δ at pub 0.0206
14
GAT
actual #14 vs paper #14
0.5559 ±0.0027
actual #14 vs paper #14
paper 0.5559 ±0.0027
paper 0.5559 ±0.0027 Δ at pub 0.0289
15
GraphSAGE
0.5540 ±0.0020
18
Polynormer
actual #18 vs paper #18
0.5496 ±0.0022
actual #18 vs paper #18
paper 0.5496 ±0.0022

Improvement within reported uncertainty; not highlighted.

paper 0.5496 ±0.0022 Δ at pub 0.0025
23
SGFormer
actual #23 vs paper #23
0.5414 ±0.0062
actual #23 vs paper #23
paper 0.5414 ±0.0062
paper 0.5414 ±0.0062 Δ at pub 0.0176
24
GCN
actual #24 vs paper #24
0.5411 ±0.0034
actual #24 vs paper #24
paper 0.5411 ±0.0034

Improvement within reported uncertainty; not highlighted.

paper 0.5411 ±0.0034 Δ at pub 0.0031
26
GCN+TS
0.5406 ±0.0058
This paper
28
BuNN
0.5374 ±0.0051
This paper
40
GraphGPS
actual #40 vs paper #40
0.5327 ±0.0066
actual #40 vs paper #40
paper 0.5327 ±0.0066

Improvement within reported uncertainty; not highlighted.

paper 0.5327 ±0.0066 Δ at pub 0.0017
49
GCN+ReP
0.5275 ±0.0062
This paper
50
FSGNN
0.5274 ±0.0083
This paper
81
Dir-Poly
0.5073 ±0.0056
This paper
84
MLP
actual #84 vs paper #108 24 places worse
0.5058
best reported
actual #84 vs paper #108 24 places worse
paper 0.4885 ±0.0055
paper 0.4885 ±0.0055 Δ at pub 0.0173
101
MLP+TS
0.4950 ±0.0027
This paper
149
GPRGNN
0.4488 ±0.0034
This paper
154
CPGNN
actual #154 vs paper #188 34 places worse
0.4436 ±0.0035
best reported
actual #154 vs paper #188 34 places worse
paper 0.3979 ±0.0077
paper 0.3979 ±0.0077 Δ at pub 0.0457 Δ today 0.0457
160
NodeFormer
actual #160 vs paper #160
0.4386 ±0.0035
best reported
actual #160 vs paper #160
paper 0.4379 ±0.0057

Difference within reported uncertainty; not counted as underperformance.

paper 0.4379 ±0.0057 Δ at pub 0.0007 Δ today 0.0007
196
GloGNN
actual #196 vs paper #196
0.3728 ±0.0066
best reported
actual #196 vs paper #196
paper 0.3689 ±0.0014

Difference within reported uncertainty; not counted as underperformance.

paper 0.3689 ±0.0014 Δ at pub 0.0039 Δ today 0.0039

Minesweeper

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is ROC-AUC. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9903 ±0.0019
This paper
2
BuNN
0.9899 ±0.0016
This paper
3
M3Dphormer
0.9827 ±0.0020
This paper
5
GAT
actual #5 vs paper #5
0.9786 ±0.0037
actual #5 vs paper #5
paper 0.9786 ±0.0037
paper 0.9786 ±0.0037 Δ at pub 0.0585
6
GAT+T
0.9786 ±0.0037
This paper
7
GCN+TS
0.9780 ±0.0020
This paper
8
Polynormer
actual #8 vs paper #8
0.9749 ±0.0048
actual #8 vs paper #8
paper 0.9749 ±0.0048

Improvement within reported uncertainty; not highlighted.

paper 0.9749 ±0.0048 Δ at pub 0.0003
9
GCN
actual #9 vs paper #9
0.9744 ±0.0017
actual #9 vs paper #9
paper 0.9744 ±0.0017
paper 0.9744 ±0.0017 Δ at pub 0.0769
10
SAGE+T
0.9733 ±0.0094
This paper
11
SAGE
0.9709 ±0.0100
This paper
12
GCN+ReP
0.9605 ±0.0019
This paper
16
Dir-Poly
0.9374 ±0.0070
This paper
17
GraphGPS
actual #17 vs paper #22 5 places worse
0.9229 ±0.0061
best reported
actual #17 vs paper #22 5 places worse
paper 0.9075 ±0.0089
paper 0.9075 ±0.0089 Δ at pub 0.0154
20
SGFormer
0.9142 ±0.0041
This paper
24
FSGNN
0.9008 ±0.0070
This paper
25
H2GCN
0.8971 ±0.0031
This paper
27
NodeFormer
actual #27 vs paper #27
0.8771 ±0.0069
actual #27 vs paper #27
paper 0.8771 ±0.0069

Improvement within reported uncertainty; not highlighted.

paper 0.8771 ±0.0069 Δ at pub 0.0100
31
GPRGNN
0.8624 ±0.0061
This paper
43
MLP
actual #43 vs paper #58 15 places worse
0.8000
best reported
actual #43 vs paper #58 15 places worse
paper 0.5106 ±0.0176
57
CPGNN
0.5203 ±0.0546
This paper
58
GloGNN
0.5108 ±0.0123
This paper
59
MLP+TS
0.5097 ±0.0156
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published