Graph Neural Reaction Diffusion Models Submitted to the editors June 2023. Accepted in March 2024.

Moshe Eliasof, Eldad Haber, Eran Treister

Main figure for Graph Neural Reaction Diffusion Models Submitted to the editors June 2023. Accepted in March 2024.

Abstract

The integration of Graph Neural Networks (GNNs) and Neural Ordinary and Partial Differential Equations has been extensively studied in recent years. GNN architectures powered by neural differential equations allow us to reason about their behavior, and develop GNNs with desired properties such as controlled smoothing or energy conservation. In this paper we take inspiration from Turing instabilities in a Reaction Diffusion (RD) system of partial differential equations, and propose a novel family of GNNs based on neural RD systems. We blackdemonstrate that our RDGNN is powerful for the modeling of various data types, from homophilic, to heterophilic, and spatio-temporal datasets. We discuss the theoretical properties of our RDGNN, its implementation, and show that it improves or offers competitive performance to state-of-the-art methods.

Benchmark Results

Tested on 8 datasets 32 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #195 174 places worse
0.9004
best reported
actual #21 vs paper #195 174 places worse
paper 0.8577 ±0.0127
paper 0.8577 ±0.0127 Δ at pub 0.0427
22
RDGNN-I
0.8991 ±0.0110
This paper
29
RDGNN-S
0.8953 ±0.0122
This paper
39
SAGE
0.8911 ±0.0012
44
GAT
actual #44 vs paper #175 131 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #175 131 places worse
paper 0.8637 ±0.0048
paper 0.8637 ±0.0048 Δ at pub 0.0253 Δ today 0.0260
45
GCNII
actual #45 vs paper #66 21 places worse
0.8893 ±0.0137
best reported
actual #45 vs paper #66 21 places worse
paper 0.8849 ±0.0125
best at pub: Language is All a Graph Needs (2023)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8849 ±0.0125 Δ at pub 0.0044 Δ today 0.0044
51
H2GCN
actual #51 vs paper #107 56 places worse
0.8882 ±0.0011
best reported
actual #51 vs paper #107 56 places worse
paper 0.8787 ±0.0120

Difference within reported uncertainty; not counted as underperformance.

paper 0.8787 ±0.0120 Δ today 0.0095
59
PDE-GCNM
0.8860
This paper
62
GREAD
0.8857 ±0.0066
This paper
79
ACMII-GCN
0.8825 ±0.0096
This paper
82
WRGAT
0.8820 ±0.0226
This paper
96
GRAFF
0.8801 ±0.0103
This paper
103
GGCN
0.8795 ±0.0105
This paper
113
MixHop
0.8761 ±0.0203
This paper
138
NSD
0.8714 ±0.0113
This paper
168
DMP
0.8652
This paper
207
Geom-GCN
actual #207 vs paper #214 7 places worse
0.8540 ±0.0040
best reported
actual #207 vs paper #214 7 places worse
paper 0.8527 ±0.0157

Difference within reported uncertainty; not counted as underperformance.

paper 0.8527 ±0.0157 Δ at pub 0.0013
243
LINKX
0.8464 ±0.0113
This paper
724
MLP
0.7768
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
35
GAT
actual #35 vs paper #209 174 places worse
0.8080 ±0.0026
best reported
actual #35 vs paper #209 174 places worse
paper 0.7432 ±0.0123
paper 0.7432 ±0.0123 Δ at pub 0.0648
36
GCNII
actual #36 vs paper #108 72 places worse
0.8076 ±0.0030
best reported
actual #36 vs paper #108 72 places worse
paper 0.7713 ±0.0148
paper 0.7713 ±0.0148 Δ at pub 0.0363
44
GCN
actual #44 vs paper #257 213 places worse
0.8033 ±0.0088
best reported
actual #44 vs paper #257 213 places worse
paper 0.7368 ±0.0136
paper 0.7368 ±0.0136 Δ at pub 0.0575 Δ today 0.0665
61
GraphSAGE
0.7923 ±0.0053
80
PDE-GCNM
0.7848
This paper
84
RDGNN-I
0.7834 ±0.0155
This paper
88
Geom-GCN
0.7799 ±0.0115
This paper
94
RDGNN-S
0.7782 ±0.0148
This paper
99
GREAD
0.7760 ±0.0181
This paper
104
GRAFF
0.7730 ±0.0185
This paper
107
NSD
0.7714 ±0.0157
This paper
108
GGCN
0.7714 ±0.0145
This paper
110
ACMII-GCN
0.7712 ±0.0158
This paper
111
H2GCN
0.7711 ±0.0157
This paper
117
DMP
0.7687
This paper
119
WRGAT
0.7681 ±0.0189
This paper
126
MixHop
0.7626 ±0.0295
This paper
312
LINKX
0.7319 ±0.0099
This paper
350
MLP
0.7289 ±0.0010
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
16
H2GCN
actual #16 vs paper #87 71 places worse
0.9361 ±0.0013
best reported
actual #16 vs paper #87 71 places worse
paper 0.8949 ±0.0038
18
GCN
actual #18 vs paper #156 138 places worse
0.9296 ±0.0015
best reported
actual #18 vs paper #156 138 places worse
paper 0.8813 ±0.0050
20
GAT
actual #20 vs paper #180 160 places worse
0.9233 ±0.0018
best reported
actual #20 vs paper #180 160 places worse
paper 0.8762 ±0.0110
55
RDGNN-I
0.9037 ±0.0043
This paper
58
GCNII
0.9030 ±0.0043
This paper
62
GREAD
0.9023 ±0.0055
This paper
66
RDGNN-S
0.9011 ±0.0062
This paper
69
Geom-GCN
0.9005 ±0.0047
This paper
70
MixHop
actual #70 vs paper #247 177 places worse
0.9004 ±0.0141
best reported
actual #70 vs paper #247 177 places worse
paper 0.8531 ±0.0229
best at pub: Language is All a Graph Needs (2023)
paper 0.8531 ±0.0229 Δ at pub 0.0473
71
GRAFF
0.9004 ±0.0041
This paper
75
PDE-GCNM
0.8993
This paper
83
ACMII-GCN
0.8971 ±0.0048
This paper
88
NSD
0.8949 ±0.0040
This paper
96
DMP
0.8927
This paper
98
GGCN
0.8915 ±0.0037
This paper
116
SAGE
0.8881 ±0.0015
129
WRGAT
0.8852 ±0.0092
This paper
162
LINKX
0.8786 ±0.0077
This paper
210
MLP
0.8690 ±0.0074

Heterophilic Graphs

#ModelAccuracy ↑Paper
1
P^2GNN
0.9672 ±0.0147
2
DoG
0.9660 ±0.0210
3
GPF-plus
0.9583 ±0.0419
9
RDGNN-S
0.9459 ±0.0597
This paper
19
RDGNN-I
0.9351 ±0.0593
This paper
24
PDE-GCNM
0.9324
This paper
28
GPRGNN
actual #28 vs paper #269 241 places worse
0.9295 ±0.0131
best reported
actual #28 vs paper #269 241 places worse
paper 0.7838 ±0.0436
paper 0.7838 ±0.0436 Δ at pub 0.1454 Δ today 0.1457
34
MLP
0.9230 ±0.0070
39
GGCN
actual #39 vs paper #148 109 places worse
0.9213 ±0.0305
best reported
actual #39 vs paper #148 109 places worse
paper 0.8486 ±0.0455
best today: Graph Wave Networks (WWW 2025)
paper 0.8486 ±0.0455 Δ at pub 0.0200 Δ today 0.0727
40
H2GCN
actual #40 vs paper #148 108 places worse
0.9189 ±0.0393
best reported
actual #40 vs paper #148 108 places worse
paper 0.8486 ±0.0723

Difference within reported uncertainty; not counted as underperformance.

paper 0.8486 ±0.0723 Δ at pub 0.0279 Δ today 0.0703
53
GraphSAGE
0.9000 ±0.0365
57
GREAD
actual #57 vs paper #57
0.8973 ±0.0449
actual #57 vs paper #57
paper 0.8973 ±0.0449

Improvement within reported uncertainty; not highlighted.

paper 0.8973 ±0.0449 Δ at pub 0.0514
61
FAGCN
actual #61 vs paper #193 132 places worse
0.8961 ±0.0152
best reported
actual #61 vs paper #193 132 places worse
paper 0.8243 ±0.0287
paper 0.8243 ±0.0287 Δ at pub 0.0718
68
DMP
actual #68 vs paper #68
0.8919
actual #68 vs paper #68
paper 0.8919

Improvement within reported uncertainty; not highlighted.

paper 0.8919 Δ at pub 0.0755
70
GCNII
actual #70 vs paper #398 328 places worse
0.8918 ±0.0443
best reported
actual #70 vs paper #398 328 places worse
paper 0.6946 ±0.0383
paper 0.6946 ±0.0383 Δ at pub 0.1211 Δ today 0.1972
82
GRAFF
0.8838 ±0.0453
This paper
83
ACMII-GCN
0.8838 ±0.0343
This paper
98
G2
0.8757 ±0.0386
This paper
104
WRGAT
actual #104 vs paper #173 69 places worse
0.8698
best reported
actual #104 vs paper #173 69 places worse
paper 0.8362 ±0.0550

Difference within reported uncertainty; not counted as underperformance.

paper 0.8362 ±0.0550 Δ at pub 0.0336
115
ACMP-GCN
0.8620 ±0.0300
This paper
121
NSD
0.8595 ±0.0551
This paper
137
GraphCON
0.8540 ±0.0420
This paper
181
MagNet
0.8330 ±0.0610
This paper
211
GAT
actual #211 vs paper #533 322 places worse
0.8162 ±0.0645
best reported
actual #211 vs paper #533 322 places worse
paper 0.5838 ±0.0663
paper 0.5838 ±0.0663 Δ at pub 0.2162 Δ today 0.2324
217
GRAND
actual #217 vs paper #308 91 places worse
0.8140 ±0.0350
best reported
actual #217 vs paper #308 91 places worse
paper 0.7568 ±0.0725

Difference within reported uncertainty; not counted as underperformance.

paper 0.7568 ±0.0725 Δ at pub 0.0452 Δ today 0.0572
257
GCN
actual #257 vs paper #576 319 places worse
0.7933 ±0.0447
best reported
actual #257 vs paper #576 319 places worse
paper 0.5216 ±0.0516
best today: Graph Wave Networks (WWW 2025)
paper 0.5216 ±0.0516 Δ at pub 0.2624 Δ today 0.2717
276
MixHop
0.7784 ±0.0773
This paper
325
LINKX
0.7460 ±0.0837
This paper
415
Geom-GCN
actual #415 vs paper #415
0.6760
best reported
actual #415 vs paper #415
paper 0.6757 ±0.0272

Difference within reported uncertainty; not counted as underperformance.

paper 0.6757 ±0.0272 Δ at pub 0.0003
#ModelAccuracy ↑Paper
1
P^2GNN
0.9541 ±0.0272
2
ACM-GCN
0.9480 ±0.0380
3
RF-GCN
0.9429
12
RDGNN-I
0.9272 ±0.0588
This paper
14
RDGNN-S
0.9243 ±0.0551
This paper
15
GGCN
actual #15 vs paper #79 64 places worse
0.9230 ±0.0367
best reported
actual #15 vs paper #79 64 places worse
paper 0.8568 ±0.0663

Difference within reported uncertainty; not counted as underperformance.

paper 0.8568 ±0.0663 Δ today 0.0662
22
GPRGNN
actual #22 vs paper #177 155 places worse
0.9157 ±0.0196
best reported
actual #22 vs paper #177 155 places worse
paper 0.8027 ±0.0811

Difference within reported uncertainty; not counted as underperformance.

paper 0.8027 ±0.0811 Δ at pub 0.1130
24
MLP
0.9136 ±0.0070
29
PDE-GCNM
0.8973
This paper
31
DMP
actual #31 vs paper #31
0.8919
actual #31 vs paper #31
paper 0.8919

Improvement within reported uncertainty; not highlighted.

paper 0.8919 Δ at pub 0.0219
35
GCNII
actual #35 vs paper #233 198 places worse
0.8918 ±0.0396
best reported
actual #35 vs paper #233 198 places worse
paper 0.7486 ±0.0379
paper 0.7486 ±0.0379 Δ at pub 0.0940 Δ today 0.1432
38
FAGCN
actual #38 vs paper #185 147 places worse
0.8852 ±0.0133
best reported
actual #38 vs paper #185 147 places worse
paper 0.7919 ±0.0587
paper 0.7919 ±0.0587 Δ at pub 0.0933
49
G2
0.8730 ±0.0484
This paper
52
GREAD
actual #52 vs paper #52
0.8703 ±0.0495
actual #52 vs paper #52
paper 0.8703 ±0.0495
62
NSD
0.8649 ±0.0471
This paper
63
ACMII-GCN
0.8649 ±0.0673
This paper
68
H2GCN
actual #68 vs paper #136 68 places worse
0.8623 ±0.0471
best reported
actual #68 vs paper #136 68 places worse
paper 0.8270 ±0.0528

Difference within reported uncertainty; not counted as underperformance.

paper 0.8270 ±0.0528 Δ at pub 0.0240 Δ today 0.0353
83
ACMP-GCN
0.8540 ±0.0700
This paper
106
MagNet
actual #106 vs paper #106
0.8430 ±0.0700
actual #106 vs paper #106
paper 0.8430 ±0.0700

Improvement within reported uncertainty; not highlighted.

paper 0.8430 ±0.0700 Δ at pub 0.0490
107
GraphCON
0.8430 ±0.0480
This paper
112
GRAFF
0.8405 ±0.0610
This paper
123
LINKX
actual #123 vs paper #203 80 places worse
0.8346 ±0.0061
best reported
actual #123 vs paper #203 80 places worse
paper 0.7784 ±0.0581

Difference within reported uncertainty; not counted as underperformance.

paper 0.7784 ±0.0581 Δ at pub 0.0562
138
SAGE
0.8269
142
GRAND
actual #142 vs paper #151 9 places worse
0.8246 ±0.0709
best reported
actual #142 vs paper #151 9 places worse
paper 0.8216 ±0.0709

Difference within reported uncertainty; not counted as underperformance.

paper 0.8216 ±0.0709 Δ at pub 0.0004 Δ today 0.0030
158
GAT
actual #158 vs paper #434 276 places worse
0.8190 ±0.0540
best reported
actual #158 vs paper #434 276 places worse
paper 0.5432 ±0.0505
paper 0.5432 ±0.0505 Δ at pub 0.2758
160
WRGAT
0.8162 ±0.0390
This paper
170
GCN
actual #170 vs paper #459 289 places worse
0.8082 ±0.0360
best reported
actual #170 vs paper #459 289 places worse
paper 0.5270 ±0.0530
paper 0.5270 ±0.0530 Δ at pub 0.2745 Δ today 0.2812
183
MixHop
actual #183 vs paper #249 66 places worse
0.7950 ±0.0630
best reported
actual #183 vs paper #249 66 places worse
paper 0.7351 ±0.0634

Difference within reported uncertainty; not counted as underperformance.

paper 0.7351 ±0.0634 Δ at pub 0.0599
342
Geom-GCN
actual #342 vs paper #369 27 places worse
0.6412
best reported
actual #342 vs paper #369 27 places worse
paper 0.6081 ±0.0367

Difference within reported uncertainty; not counted as underperformance.

paper 0.6081 ±0.0367 Δ at pub 0.0331
#ModelAccuracy ↑Paper
1
DiGGR
0.4535 ±0.0353
2
TRIGON
0.4402 ±0.0028
3
DoG
0.4320 ±0.0120
38
GCNII
actual #38 vs paper #290 252 places worse
0.4082 ±0.0179
best reported
actual #38 vs paper #290 252 places worse
paper 0.3287 ±0.0130
paper 0.3287 ±0.0130 Δ at pub 0.0574 Δ today 0.0795
42
MLP
0.4026 ±0.0108
52
GPRGNN
actual #52 vs paper #247 195 places worse
0.3992 ±0.0067
best reported
actual #52 vs paper #247 195 places worse
paper 0.3463 ±0.0122
paper 0.3463 ±0.0122 Δ at pub 0.0529 Δ today 0.0529
56
FAGCN
actual #56 vs paper #240 184 places worse
0.3970
best reported
actual #56 vs paper #240 184 places worse
paper 0.3487 ±0.0135
paper 0.3487 ±0.0135 Δ at pub 0.0483
62
GGCN
actual #62 vs paper #99 37 places worse
0.3929 ±0.0048
best reported
actual #62 vs paper #99 37 places worse
paper 0.3781 ±0.0156

Difference within reported uncertainty; not counted as underperformance.

paper 0.3781 ±0.0156 Δ today 0.0148
68
GraphSAGE
0.3899 ±0.0085
71
H2GCN
actual #71 vs paper #198 127 places worse
0.3885 ±0.0117
best reported
actual #71 vs paper #198 127 places worse
paper 0.3570 ±0.0100
paper 0.3570 ±0.0100 Δ at pub 0.0270 Δ today 0.0315
72
RDGNN-I
0.3869 ±0.0141
This paper
75
WRGAT
actual #75 vs paper #158 83 places worse
0.3860 ±0.0110
best reported
actual #75 vs paper #158 83 places worse
paper 0.3653 ±0.0077
paper 0.3653 ±0.0077 Δ at pub 0.0207
78
RDGNN-S
0.3855 ±0.0134
This paper
87
Geom-GCN
actual #87 vs paper #305 218 places worse
0.3810
best reported
actual #87 vs paper #305 218 places worse
paper 0.3163 ±0.0115
paper 0.3163 ±0.0115 Δ at pub 0.0647
96
GREAD
actual #96 vs paper #96
0.3790 ±0.0117
actual #96 vs paper #96
paper 0.3790 ±0.0117

Improvement within reported uncertainty; not highlighted.

paper 0.3790 ±0.0117 Δ at pub 0.0031
100
NSD
actual #100 vs paper #105 5 places worse
0.3781 ±0.0115
best reported
actual #100 vs paper #105 5 places worse
paper 0.3779 ±0.0115
best at pub: Graph Parsing Networks (ICLR 2024)

Difference within reported uncertainty; not counted as underperformance.

paper 0.3779 ±0.0115 Δ at pub 0.0002
120
G2
0.3730 ±0.0101
This paper
122
DMP
actual #122 vs paper #197 75 places worse
0.3726 ±0.0179
best reported
actual #122 vs paper #197 75 places worse
paper 0.3572

Difference within reported uncertainty; not counted as underperformance.

paper 0.3572 Δ at pub 0.0154
129
GRAFF
0.3711 ±0.0108
This paper
131
ACMII-GCN
0.3709 ±0.0132
This paper
135
GCN
actual #135 vs paper #411 276 places worse
0.3690
best reported
actual #135 vs paper #411 276 places worse
paper 0.2686 ±0.0110
paper 0.2686 ±0.0110 Δ at pub 0.1004
162
MixHop
actual #162 vs paper #297 135 places worse
0.3648 ±0.0120
best reported
actual #162 vs paper #297 135 places worse
paper 0.3222 ±0.0234
paper 0.3222 ±0.0234 Δ at pub 0.0426
180
LINKX
0.3610 ±0.0155
This paper
182
GAT
actual #182 vs paper #385 203 places worse
0.3605 ±0.0035
best reported
actual #182 vs paper #385 203 places worse
paper 0.2845 ±0.0089
paper 0.2845 ±0.0089 Δ at pub 0.0760
203
GRAND
0.3562 ±0.0101
This paper
#ModelAccuracy ↑Paper
1
IBG-NN
0.7763 ±0.0179
2
Dir-GNN+CNA
0.7747 ±0.0128
3
DHGNN
0.7684 ±0.0161
26
ACMII-GCN
0.6740 ±0.0221
This paper
27
RDGNN-S
0.6596 ±0.0211
This paper
28
RDGNN-I
0.6562 ±0.0233
This paper
32
G2
0.6426 ±0.0238
This paper
39
H2GCN
actual #39 vs paper #202 163 places worse
0.6190 ±0.0140
best reported
actual #39 vs paper #202 163 places worse
paper 0.3648 ±0.0186
paper 0.3648 ±0.0186 Δ at pub 0.0427 Δ today 0.2542
40
LINKX
0.6181 ±0.0180
This paper
46
GCN
actual #46 vs paper #267 221 places worse
0.6067
best reported
actual #46 vs paper #267 221 places worse
paper 0.2396 ±0.0201
paper 0.2396 ±0.0201 Δ at pub 0.3671
51
GREAD
0.5922 ±0.0144
This paper
53
GRAFF
0.5901 ±0.0131
This paper
65
NSD
0.5634 ±0.0132
This paper
67
GAT
actual #67 vs paper #241 174 places worse
0.5630 ±0.0220
best reported
actual #67 vs paper #241 174 places worse
paper 0.3003 ±0.0155
paper 0.3003 ±0.0155 Δ at pub 0.2627
69
GGCN
actual #69 vs paper #71 2 places worse
0.5567 ±0.0187
best reported
actual #69 vs paper #71 2 places worse
paper 0.5517 ±0.0158

Difference within reported uncertainty; not counted as underperformance.

paper 0.5517 ±0.0158 Δ today 0.0050
76
GPRGNN
actual #76 vs paper #235 159 places worse
0.5435 ±0.0087
best reported
actual #76 vs paper #235 159 places worse
paper 0.3161 ±0.0124
paper 0.3161 ±0.0124 Δ at pub 0.1854 Δ today 0.2274
96
WRGAT
0.4885 ±0.0078
This paper
101
DMP
0.4726
This paper
120
SAGE
0.4460 ±0.0130
127
MixHop
0.4380 ±0.0148
This paper
139
FAGCN
0.4259 ±0.0069
This paper
164
GRAND
0.4005 ±0.0150
This paper
172
MLP
0.3930 ±0.0079
176
GCNII
actual #176 vs paper #178 2 places worse
0.3881 ±0.0197
best reported
actual #176 vs paper #178 2 places worse
paper 0.3847 ±0.0158

Difference within reported uncertainty; not counted as underperformance.

paper 0.3847 ±0.0158 Δ today 0.0034
179
Geom-GCN
0.3832 ±0.0092
This paper

LINKX Benchmarks

#ModelAccuracy ↑Paper
1
LargeScaleNet
0.6582 ±0.0036
2
S² DirGCN
0.6495 ±0.0033
3
FaberNet
0.6462 ±0.0101
11
RDGNN-I
0.5846 ±0.0059
This paper
13
LINKX
0.5600 ±0.0134
This paper
15
RDGNN-S
0.5516 ±0.0046
This paper
17
LINK
0.5397 ±0.0018
This paper
19
MixHop
0.5181 ±0.0017
This paper
22
GAT
actual #22 vs paper #30 8 places worse
0.4937 ±0.0020
best reported
actual #22 vs paper #30 8 places worse
paper 0.4605 ±0.0051
paper 0.4605 ±0.0051 Δ at pub 0.0332
23
H2GCN
actual #23 vs paper #23
0.4910 ±0.0010
best reported
actual #23 vs paper #23
paper 0.4909 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.4909 ±0.0010 Δ at pub 0.0001
26
GCNII
0.4721 ±0.0028
This paper
30
L Prop (2 hop)
0.4607 ±0.0015
This paper
31
GCN
0.4602 ±0.0026
This paper
32
GPR-GNN
actual #32 vs paper #34 2 places worse
0.4597 ±0.0026
best reported
actual #32 vs paper #34 2 places worse
paper 0.4507 ±0.0021
paper 0.4507 ±0.0021 Δ at pub 0.0090
40
C&S (2 hop)
0.4217 ±0.0027
This paper
53
APPNP
0.3815 ±0.0026
This paper
56
MLP
0.3670 ±0.0021
This paper
59
SGC (2 hop)
0.3227 ±0.0006
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere