Incorporating Heterophily into Graph Neural Networks for Graph Classification
Abstract
Graph Neural Networks (GNNs) often assume strong homophily for graph classification, seldom considering heterophily, which means connected nodes tend to have different class labels and dissimilar features. In real-world scenarios, graphs may have nodes that exhibit both homophily and heterophily. Failing to generalize to this setting makes many GNNs underperform in graph classification. In this paper, we address this limitation by identifying three effective designs and develop a novel GNN architecture called IHGNN (ncorporating eterophily into raph eural etworks). These designs include the combination of integration and separation of the ego- and neighbor-embeddings of nodes, adaptive aggregation of node embeddings from different layers, and differentiation between different node embeddings for constructing the graph-level readout function. We empirically validate IHGNN on various graph datasets and demonstrate that it outperforms the state-of-the-art GNNs for graph classification.
Benchmark Results
Tested on 2 datasets 4 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) |
| 63 | GCN | 0.9220
±0.0440 | |
| 139 | PPGNs | 0.9060
±0.0870 best reported | best at pub: Weisfeiler and Lehman Go Cellular: CW Networks (NeurIPS 2021) best today: Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing (2025) Difference within reported uncertainty; not counted as underperformance. |
| 201 | IHGNN | 0.8990
±0.0600 | This paper |
| 224 | Graphormer | 0.8960
±0.0620 best reported | best today: Graph Classification via Reference Distribution Learning: Theory and Practice (NeurIPS 2024) Difference within reported uncertainty; not counted as underperformance. |
| 239 | DiffPool | 0.8940
±0.0460 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) best today: Graph Classification via Reference Distribution Learning: Theory and Practice (NeurIPS 2024) |
| 314 | PGCN | 0.8840
±0.0210 | This paper |
| 345 | PCNet | 0.8780
±0.0720 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 413 | GNNML | 0.8620
±0.0780 | This paper |
| 425 | DGCNN | 0.8583
±0.0116 best reported | best at pub: Deep Learning on Attributed Graphs: A Journey from Graphs to Their Embeddings and Back (2018) best today: Graph Structure Refinement with Energy-based Contrastive Learning (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 487 | TokenGT | 0.8400
±0.0600 | This paper |
| 507 | DCGNN | 0.8350
±0.0640 | This paper |
| 527 | k-GNNs | 0.8290
±0.0680 | This paper |
| 551 | H2GCN | 0.8240
±0.0590 | This paper |
| 594 | ACM | 0.8080
±0.0810 | This paper |
| 624 | GPR-GNN | 0.7980
±0.1090 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 23 | GCN | 0.8260
±0.0220 | |
| 30 | GIN | 0.8220
±0.0210 best reported | best at pub: On the Equivalence between Graph Isomorphism Testing and Function Approximation with GNNs (NeurIPS 2019) best today: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) |
| 33 | DiffPool | 0.8213
±0.0043 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) best today: Scalable Graph Compressed Convolutions (2024) |
| 38 | Graphormer | 0.8180
±0.0224 best reported | |
| 145 | H2GCN | 0.7950
±0.0170 | This paper |
| 151 | MLP | 0.7920
±0.0240 | |
| 160 | IHGNN | 0.7900
±0.0200 | This paper |
| 169 | GNNML | 0.7850
±0.0170 | This paper |
| 182 | ACM | 0.7780
±0.0150 | This paper |
| 191 | DGCNN | 0.7759
±0.0224 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) best today: Explainable Graph Representation Learning via Graph Pattern Analysis (IJCAI 2025) |
| 272 | PGCN | 0.7330
±0.0160 | This paper |
| 284 | PCNet | 0.7220
±0.0220 | This paper |
| 300 | DCGNN | 0.7030
±0.0270 | This paper |
| 316 | TokenGT | 0.6610
±0.0300 | This paper |
| 345 | GPR-GNN | 0.5200
±0.0590 | This paper |
