IJCAI 2023

Graph Neural Convection-Diffusion with Heterophily

Kai Zhao, Qiyu Kang, Yang Song, Rui She, Sijie Wang, Wee Peng Tay

Main figure for Graph Neural Convection-Diffusion with Heterophily

Abstract

Graph neural networks (GNNs) have shown promising results across various graph learning tasks, but they often assume homophily, which can result in poor performance on heterophilic graphs. The connected nodes are likely to be from different classes or have dissimilar features on heterophilic graphs. In this paper, we propose a novel GNN that incorporates the principle of heterophily by modeling the flow of information on nodes using the convection-diffusion equation (CDE). This allows the CDE to take into account both the diffusion of information due to homophily and the ``convection'' of information due to heterophily. We conduct extensive experiments, which suggest that our framework can achieve competitive performance on node classification tasks for heterophilic graphs, compared to the state-of-the-art methods. The code is available at.

Benchmark Results

Tested on 6 datasets Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterophilic Graphs

#ModelAccuracy ↑Paper
1
P^2GNN
0.9672 ±0.0147
2
DoG
0.9660 ±0.0210
3
GPF-plus
0.9583 ±0.0419
34
MLP
0.9230 ±0.0070
53
GraphSAGE
0.9000 ±0.0365
116
ACMP
0.8620 ±0.0300
This paper
#ModelAccuracy ↑Paper
1
DMD++
0.9190 ±0.0260
2
F-GREAD-BS
0.9059 ±0.0380
3
APPNP
0.9010 ±0.0350
37
MLP
0.8629 ±0.0450
38
ACMP
0.8610 ±0.0400
This paper
63
GCN
0.8310 ±0.0320

Heterophily Benchmark

#ModelAccuracy ↑Paper
1
Dir-Poly
0.9451 ±0.0022
2
D-CDE
0.9387 ±0.0041
3
LargeScaleNet
0.9358 ±0.0024
17
CDE-GRAND-GAT
0.9164 ±0.0028
This paper
19
CDE-GRAND
0.9164 ±0.0028
This paper
20
CDE-GRAND-TRANS
0.9155 ±0.0023
This paper
26
GraphSAGE
0.9106 ±0.0027
28
CDE-GRAND-LAP
0.9058 ±0.0049
This paper
65
CDE-GraphBel
0.8539 ±0.0046
This paper
97
CDE-Diag-NSD
0.7899 ±0.0052
This paper
119
ACMP
0.7127 ±0.0059
This paper
121
GRAND-TRANS
0.7118 ±0.0056
This paper
127
GRAND-LAP
0.6924 ±0.0053
This paper
135
MLP
0.6665 ±0.0047
#ModelAccuracy ↑Paper
1
UniGAP
0.6375 ±0.0110
2
H2GCN + HalfHop
0.5961 ±0.0100
3
GraphSAGE + HalfHop
0.5897 ±0.0150
12
SAGE
0.5569 ±0.0023
84
MLP
0.5058
128
CDE-GRAND
0.4763 ±0.0043
This paper
146
CDE-GraphBel
0.4522 ±0.0060
This paper
151
ACMP
0.4476 ±0.0052
This paper
#ModelROC-AUC ↑Paper
1
BuNN
0.9899 ±0.0016
2
DC-GNN
0.9850 ±0.0021
3
Tango -GPS
0.9839 ±0.0054
17
CDE-GRAND-GAT
0.9550 ±0.0523
This paper
19
CDE-GRAND
0.9550 ±0.0523
This paper
34
CDE-GraphBel
0.9398 ±0.0057
This paper
42
GraphSAGE
0.9358 ±0.0005
69
CDE-GRAND-TRANS
0.9138 ±0.0192
This paper
71
CDE-Diag-NSD
0.9113 ±0.0080
This paper
84
CDE-GRAND-LAP
0.9006 ±0.0060
This paper
125
ACMP
0.7615 ±0.0112
This paper
126
GRAND-TRANS
0.7540 ±0.0136
This paper
130
GRAND-LAP
0.7325 ±0.0099
This paper
156
MLP
0.5099 ±0.0147

Questions

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is ROC-AUC. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
MLP
0.9733 ±0.0006
2
AGS-GNN
0.9727
3
MeanGNN
0.9716 ±0.0006
4
GCN
0.9715 ±0.0004
36
CDE-GRAND-GAT
0.7517 ±0.0099
This paper
40
CDE-GRAND-LAP
0.7378 ±0.0146
This paper
41
CDE-Diag-NSD
0.7365 ±0.0155
This paper
42
CDE-GRAND-TRANS
0.7292 ±0.0154
This paper
44
CDE-GraphBel
0.7211 ±0.0131
This paper
47
GRAND-TRANS
0.6914 ±0.0097
This paper
48
GRAND-LAP
0.6854 ±0.0107
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers)