Homophily-oriented Heterogeneous Graph Rewiring
Abstract
With the rapid development of the World Wide Web (WWW), heterogeneous graphs (HG) have explosive growth. Recently, heterogeneous graph neural network (HGNN) has shown great potential in learning on HG. Current studies of HGNN mainly focus on some HGs with strong homophily properties (nodes connected by meta-path tend to have the same labels), while few discussions are made in those that are less homophilous. Recently, there have been many works on homogeneous graphs with heterophily. However, due to heterogeneity, it is non-trivial to extend their approach to deal with HGs with heterophily. In this work, based on empirical observations, we propose a meta-path-induced metric to measure the homophily degree of a HG. We also find that current HGNNs may have degenerated performance when handling HGs with less homophilous properties. Thus it is essential to increase the generalization ability of HGNNs on non-homophilous HGs. To this end, we propose HDHGR, a homophily-oriented deep heterogeneous graph rewiring approach that modifies the HG structure to increase the performance of HGNN. We theoretically verify HDHGR. In addition, experiments on real-world HGs demonstrate the effectiveness of HDHGR, which brings at most more than 10\
Benchmark Results
Tested on 4 datasets Non-standard metric on 1 dataset
Tables show presented results in global context (best 3 papers + GCN + MLP).
Heterophilic Graphs
Actor
Global leaderboard →Default metric is Accuracy. The paper reports 0 values on Accuracy , 21 values on Macro-F1 and 21 values on Micro-F1 .
Sorted by Macro-F1. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ default | Macro-F1 ↑ | Micro-F1 ↑ | Paper |
|---|---|---|---|---|---|
| 1 | CTHGE | 0.8258
±
0.0039 | —
| — | Accuracy
0.8258
±
0.0039 Micro-F1
— |
| 2 | HGT HDHGR | — | 0.7725
±
0.0053 | 0.8406
±
0.0029 | Accuracy
— Micro-F1
0.8406
±
0.0029 |
| 3 | PSHGCN | 0.7620
±
0.0128 | —
| — | Accuracy
0.7620
±
0.0128 Micro-F1
— |
| 4 | HGT origin | — | 0.7558
±
0.0048 | 0.8297
±
0.0029 | Accuracy
— Micro-F1
0.8297
±
0.0029 |
| 5 | SHGN HDHGR | — | 0.7273
±
0.0035 | 0.8136
±
0.0037 | Accuracy
— Micro-F1
0.8136
±
0.0037 |
| 6 | SHGN origin | — | 0.7166
±
0.0162 | 0.8085
±
0.0029 | Accuracy
— Micro-F1
0.8085
±
0.0029 |
| 7 | HAN HDHGR | — | 0.7113
±
0.0138 | 0.8089
±
0.0039 | Accuracy
— Micro-F1
0.8089
±
0.0039 |
| 10 | GCN HDHGR | — | 0.6721
±
0.0094 | 0.7507
±
0.0038 | Accuracy
— Micro-F1
0.7507
±
0.0038 |
| 11 | HDHGR | — | 0.6721
±
0.0094 | 0.7507
±
0.0038 | Accuracy
— Micro-F1
0.7507
±
0.0038 |
| 13 | GAT HDHGR | — | 0.6383
±
0.0056 | 0.7423
±
0.0028 | Accuracy
— Micro-F1
0.7423
±
0.0028 |
| 14 | LINKX HDHGR | — | 0.6379
±
0.0205 | 0.7023
±
0.0183 | Accuracy
— Micro-F1
0.7023
±
0.0183 |
| 15 | H2GCN HDHGR | — | 0.6267
±
0.0113 | 0.7266
±
0.0051 | Accuracy
— Micro-F1
0.7266
±
0.0051 |
| 16 | IDGL | — | 0.5964
±
0.0171 | 0.6591
±
0.0273 | Accuracy
— Micro-F1
0.6591
±
0.0273 |
| 17 | HGSL | — | 0.5835
±
0.0123 | 0.6326
±
0.0254 | Accuracy
— Micro-F1
0.6326
±
0.0254 |
| 18 | LINKX origin | — | 0.5798
±
0.0201 | 0.6397
±
0.0177 | Accuracy
— Micro-F1
0.6397
±
0.0177 |
| 19 | LDS | — | 0.5622
±
0.0324 | 0.6235
±
0.0289 | Accuracy
— Micro-F1
0.6235
±
0.0289 |
| 20 | GCN origin | — | 0.5538
±
0.0032 | 0.6579
±
0.0021 | Accuracy
— Micro-F1
0.6579
±
0.0021 |
| 21 | HAN origin | — | 0.5478
±
0.0154 | 0.6895
±
0.0026 | Accuracy
— Micro-F1
0.6895
±
0.0026 |
| 22 | RGCN HDHGR | — | 0.5333
±
0.0158 | 0.7483
±
0.0039 | Accuracy
— Micro-F1
0.7483
±
0.0039 |
| 25 | H2GCN origin | — | 0.4970
±
0.0067 | 0.6365
±
0.0076 | Accuracy
— Micro-F1
0.6365
±
0.0076 |
| 26 | RGCN origin | — | 0.4921
±
0.0248 | 0.7161
±
0.0082 | Accuracy
— Micro-F1
0.7161
±
0.0082 |
| 27 | GCN | 0.4878
±
0.0130 | —
| — | Accuracy
0.4878
±
0.0130 Micro-F1
— |
| 29 | GAT origin | — | 0.4578
±
0.0100 | 0.6091
±
0.0058 | Accuracy
— Micro-F1
0.6091
±
0.0058 |
| 31 | OriMetapath | — | 0.4218
±
0.0046 | 0.5851
±
0.0021 | Accuracy
— Micro-F1
0.5851
±
0.0021 |
Heterogeneous Graph Benchmarks
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9566
±0.0020 | |
| 2 | PSHGCN | 0.9561
±0.0012 | |
| 3 | RpHGNN | 0.9555
±0.0029 | |
| 15 | SHGN (HDHGR) | 0.9473
±0.0016 | This paper |
| 18 | GAT (HDHGR) | 0.9470
±0.0011 | This paper |
| 21 | GCN | 0.9460
±0.0031 | |
| 38 | LINKX (HDHGR) | 0.9369
±0.0026 | This paper |
| 53 | H2GCN (HDHGR) | 0.9277
±0.0031 | This paper |
| 54 | RGCN (HDHGR) | 0.9259
±0.0063 | This paper |
| 56 | HAN (HDHGR) | 0.9257
±0.0056 | This paper |
| 67 | GCN (HDHGR) | 0.9201
±0.0010 | This paper |
| 176 | MLP | 0.6447
±0.0136 |
ACM
Global leaderboard →Default metric is Micro-F1. The paper reports 6 values on Micro-F1 and 8 values on Macro-F1 .
| # | Model | Micro-F1 ↑ default | Macro-F1 ↑ | Paper |
|---|---|---|---|---|
| 1 | LMSPS | 0.9469
±
0.0036 | — | |
| 2 | PSHGCN | 0.9427
±
0.0023 | — | |
| 3 | SlotGAT | 0.9406
±
0.0022 | — | |
| 12 | SHGN | 0.9335
±
0.0045 | 0.9342
±
0.0044 | Macro-F1
0.9342
±
0.0044 |
| 18 | HDHGR | 0.9280
±
0.0025 | 0.9287
±
0.0024 | Macro-F1
0.9287
±
0.0024 |
| 19 | GAT | —
| 0.9226
±
0.0094 | Macro-F1
0.9226
±
0.0094 |
| 29 | GCN | —
| 0.9217
±
0.0024 | Macro-F1
0.9217
±
0.0024 |
| 43 | HAN | 0.9147
±0.0022 best reported | 0.9089
±
0.0043 | Macro-F1
0.9089
±
0.0043 best at pub: Heterogeneous Graph Benchmarks (KDD 2021) best today: Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning (NeurIPS 2024) |
| 44 | RGCN | 0.9141
±
0.0075 | 0.9155
±
0.0074 | Macro-F1
0.9155
±
0.0074 |
| 49 | GIN | 0.9092 | — | |
| 73 | H2GCN | 0.8863
±
0.0048 | 0.8879
±
0.0045 | Macro-F1
0.8879
±
0.0045 |
| 96 | LINKX | 0.8480
±
0.0038 | 0.8475
±
0.0038 | Macro-F1
0.8475
±
0.0038 |
| 109 | MLP | 0.7102
±
0.0221 | — |
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | ELLA | 0.7930
±0.0010 | |
| 2 | MHGCN | 0.7820
±0.0138 | |
| 3 | PSHGCN | 0.7446
±0.0032 | |
| 14 | GCN | 0.6813
±0.0083 | |
| 58 | HAN HDHGR | 0.5932
±0.0053 | This paper |
| 60 | GCN HDHGR | 0.5897
±0.0041 | This paper |
| 62 | GAT HDHGR | 0.5799
±0.0216 | This paper |
| 66 | GCN origin | 0.5684
±0.0266 | This paper |
| 67 | SHGN HDHGR | 0.5656
±0.0048 | This paper |
| 70 | H2GCN HDHGR | 0.5603
±0.0024 | This paper |
| 71 | GAT origin | 0.5582
±0.0211 | This paper |
| 72 | HAN origin | 0.5581
±0.0169 | This paper |
| 73 | RGCN HDHGR | 0.5545
±0.0071 | This paper |
| 74 | MLP | 0.5514 | |
| 76 | H2GCN origin | 0.5429
±0.0062 | This paper |
| 79 | HGT HDHGR | 0.5293
±0.0162 | This paper |
| 80 | RGCN origin | 0.5251
±0.0267 | This paper |
| 81 | SHGN origin | 0.5250
±0.0091 | This paper |
| 84 | HGT origin | 0.5088
±0.0041 | This paper |
| 90 | LINKX HDHGR | 0.4830
±0.0085 | This paper |
| 96 | LINKX origin | 0.4411
±0.0112 | This paper |
