Graph Neural Convection-Diffusion with Heterophily
Abstract
Graph neural networks (GNNs) have shown promising results across various graph learning tasks, but they often assume homophily, which can result in poor performance on heterophilic graphs. The connected nodes are likely to be from different classes or have dissimilar features on heterophilic graphs. In this paper, we propose a novel GNN that incorporates the principle of heterophily by modeling the flow of information on nodes using the convection-diffusion equation (CDE). This allows the CDE to take into account both the diffusion of information due to homophily and the ``convection'' of information due to heterophily. We conduct extensive experiments, which suggest that our framework can achieve competitive performance on node classification tasks for heterophilic graphs, compared to the state-of-the-art methods. The code is available at.
Benchmark Results
Tested on 6 datasets Non-standard metric on 1 dataset
Tables show presented results in global context (best 3 papers + GCN + MLP).
Heterophilic Graphs
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | P^2GNN | 0.9672
±0.0147 | |
| 2 | DoG | 0.9660
±0.0210 | |
| 3 | GPF-plus | 0.9583
±0.0419 | |
| 34 | MLP | 0.9230
±0.0070 | |
| 53 | GraphSAGE | 0.9000
±0.0365 | |
| 116 | ACMP | 0.8620
±0.0300 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | DMD++ | 0.9190
±0.0260 | |
| 2 | F-GREAD-BS | 0.9059
±0.0380 | |
| 3 | APPNP | 0.9010
±0.0350 | |
| 37 | MLP | 0.8629
±0.0450 | |
| 38 | ACMP | 0.8610
±0.0400 | This paper |
| 63 | GCN | 0.8310
±0.0320 |
Heterophily Benchmark
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | Dir-Poly | 0.9451
±0.0022 | |
| 2 | D-CDE | 0.9387
±0.0041 | |
| 3 | LargeScaleNet | 0.9358
±0.0024 | |
| 17 | CDE-GRAND-GAT | 0.9164
±0.0028 | This paper |
| 19 | CDE-GRAND | 0.9164
±0.0028 | This paper |
| 20 | CDE-GRAND-TRANS | 0.9155
±0.0023 | This paper |
| 26 | GraphSAGE | 0.9106
±0.0027 | |
| 28 | CDE-GRAND-LAP | 0.9058
±0.0049 | This paper |
| 65 | CDE-GraphBel | 0.8539
±0.0046 | This paper |
| 97 | CDE-Diag-NSD | 0.7899
±0.0052 | This paper |
| 119 | ACMP | 0.7127
±0.0059 | This paper |
| 121 | GRAND-TRANS | 0.7118
±0.0056 | This paper |
| 127 | GRAND-LAP | 0.6924
±0.0053 | This paper |
| 135 | MLP | 0.6665
±0.0047 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | UniGAP | 0.6375
±0.0110 | |
| 2 | H2GCN + HalfHop | 0.5961
±0.0100 | |
| 3 | GraphSAGE + HalfHop | 0.5897
±0.0150 | |
| 12 | SAGE | 0.5569
±0.0023 | |
| 84 | MLP | 0.5058 | |
| 128 | CDE-GRAND | 0.4763
±0.0043 | This paper |
| 146 | CDE-GraphBel | 0.4522
±0.0060 | This paper |
| 151 | ACMP | 0.4476
±0.0052 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | BuNN | 0.9899
±0.0016 | |
| 2 | DC-GNN | 0.9850
±0.0021 | |
| 3 | Tango -GPS | 0.9839
±0.0054 | |
| 17 | CDE-GRAND-GAT | 0.9550
±0.0523 | This paper |
| 19 | CDE-GRAND | 0.9550
±0.0523 | This paper |
| 34 | CDE-GraphBel | 0.9398
±0.0057 | This paper |
| 42 | GraphSAGE | 0.9358
±0.0005 | |
| 69 | CDE-GRAND-TRANS | 0.9138
±0.0192 | This paper |
| 71 | CDE-Diag-NSD | 0.9113
±0.0080 | This paper |
| 84 | CDE-GRAND-LAP | 0.9006
±0.0060 | This paper |
| 125 | ACMP | 0.7615
±0.0112 | This paper |
| 126 | GRAND-TRANS | 0.7540
±0.0136 | This paper |
| 130 | GRAND-LAP | 0.7325
±0.0099 | This paper |
| 156 | MLP | 0.5099
±0.0147 |
Questions
Global leaderboard →Sorted by Accuracy. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MLP | 0.9733
±0.0006 | |
| 2 | AGS-GNN | 0.9727 | |
| 3 | MeanGNN | 0.9716
±0.0006 | |
| 4 | GCN | 0.9715
±0.0004 | |
| 36 | CDE-GRAND-GAT | 0.7517
±0.0099 | This paper |
| 40 | CDE-GRAND-LAP | 0.7378
±0.0146 | This paper |
| 41 | CDE-Diag-NSD | 0.7365
±0.0155 | This paper |
| 42 | CDE-GRAND-TRANS | 0.7292
±0.0154 | This paper |
| 44 | CDE-GraphBel | 0.7211
±0.0131 | This paper |
| 47 | GRAND-TRANS | 0.6914
±0.0097 | This paper |
| 48 | GRAND-LAP | 0.6854
±0.0107 | This paper |
