Incorporating Heterophily into Graph Neural Networks for Graph Classification

Wei Ye, Jiayi Yang, Sourav Medya, Ambuj K. Singh

Main figure for Incorporating Heterophily into Graph Neural Networks for Graph Classification

Abstract

Graph Neural Networks (GNNs) often assume strong homophily for graph classification, seldom considering heterophily, which means connected nodes tend to have different class labels and dissimilar features. In real-world scenarios, graphs may have nodes that exhibit both homophily and heterophily. Failing to generalize to this setting makes many GNNs underperform in graph classification. In this paper, we address this limitation by identifying three effective designs and develop a novel GNN architecture called IHGNN (ncorporating eterophily into raph eural etworks). These designs include the combination of integration and separation of the ego- and neighbor-embeddings of nodes, adaptive aggregation of node embeddings from different layers, and differentiation between different node embeddings for constructing the graph-level readout function. We empirically validate IHGNN on various graph datasets and demonstrate that it outperforms the state-of-the-art GNNs for graph classification.

Proposed method: IHGNN

Benchmark Results

Tested on 2 datasets 4 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
actual #39 vs paper #511 472 places worse
0.9330 ±0.0290
best reported
actual #39 vs paper #511 472 places worse
paper 0.8340 ±0.0640
paper 0.8340 ±0.0640 Δ at pub 0.0990
63
GCN
0.9220 ±0.0440
139
PPGNs
actual #139 vs paper #400 261 places worse
0.9060 ±0.0870
best reported
actual #139 vs paper #400 261 places worse
paper 0.8670 ±0.0670

Difference within reported uncertainty; not counted as underperformance.

paper 0.8670 ±0.0670 Δ at pub 0.0390 Δ today 0.0390
201
IHGNN
0.8990 ±0.0600
This paper
224
Graphormer
actual #224 vs paper #396 172 places worse
0.8960 ±0.0620
best reported
actual #224 vs paper #396 172 places worse
paper 0.8680 ±0.0630

Difference within reported uncertainty; not counted as underperformance.

paper 0.8680 ±0.0630 Δ today 0.0280
239
DiffPool
actual #239 vs paper #597 358 places worse
0.8940 ±0.0460
best reported
actual #239 vs paper #597 358 places worse
paper 0.8060 ±0.0540
paper 0.8060 ±0.0540 Δ at pub 0.0458 Δ today 0.0880
314
PGCN
0.8840 ±0.0210
This paper
345
PCNet
0.8780 ±0.0720
This paper
403
MLP
0.8660 ±0.0495
413
GNNML
0.8620 ±0.0780
This paper
425
DGCNN
actual #425 vs paper #550 125 places worse
0.8583 ±0.0116
best reported
actual #425 vs paper #550 125 places worse
paper 0.8240 ±0.0760

Difference within reported uncertainty; not counted as underperformance.

paper 0.8240 ±0.0760 Δ at pub 0.0343 Δ today 0.0343
487
TokenGT
0.8400 ±0.0600
This paper
507
DCGNN
0.8350 ±0.0640
This paper
527
k-GNNs
0.8290 ±0.0680
This paper
551
H2GCN
0.8240 ±0.0590
This paper
594
ACM
0.8080 ±0.0810
This paper
624
GPR-GNN
0.7980 ±0.1090
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9792
2
MSH-GNN
0.9640 ±0.0070
3
CoCN
0.8722 ±0.0013
23
GCN
0.8260 ±0.0220
30
GIN
actual #30 vs paper #235 205 places worse
0.8220 ±0.0210
best reported
actual #30 vs paper #235 205 places worse
paper 0.7560 ±0.0230
33
DiffPool
actual #33 vs paper #307 274 places worse
0.8213 ±0.0043
best reported
actual #33 vs paper #307 274 places worse
paper 0.6890 ±0.0200
paper 0.6890 ±0.0200 Δ at pub 0.1037 Δ today 0.1323
38
Graphormer
actual #38 vs paper #282 244 places worse
0.8180 ±0.0224
best reported
actual #38 vs paper #282 244 places worse
paper 0.7250 ±0.0210
paper 0.7250 ±0.0210 Δ today 0.0930
145
H2GCN
0.7950 ±0.0170
This paper
151
MLP
0.7920 ±0.0240
160
IHGNN
0.7900 ±0.0200
This paper
169
GNNML
0.7850 ±0.0170
This paper
182
ACM
0.7780 ±0.0150
This paper
191
DGCNN
actual #191 vs paper #290 99 places worse
0.7759 ±0.0224
best reported
actual #191 vs paper #290 99 places worse
paper 0.7120 ±0.0190
paper 0.7120 ±0.0190 Δ at pub 0.0625 Δ today 0.0639
272
PGCN
0.7330 ±0.0160
This paper
284
PCNet
0.7220 ±0.0220
This paper
300
DCGNN
0.7030 ±0.0270
This paper
316
TokenGT
0.6610 ±0.0300
This paper
345
GPR-GNN
0.5200 ±0.0590
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere