WWW 2023

Homophily-oriented Heterogeneous Graph Rewiring

Jiayan Guo, Lun Du, Wendong Bi, Qiang Fu, Xiaojun Ma, Xu Chen, Shi Han, Dongmei Zhang, Yan Zhang

Main figure for Homophily-oriented Heterogeneous Graph Rewiring

Abstract

With the rapid development of the World Wide Web (WWW), heterogeneous graphs (HG) have explosive growth. Recently, heterogeneous graph neural network (HGNN) has shown great potential in learning on HG. Current studies of HGNN mainly focus on some HGs with strong homophily properties (nodes connected by meta-path tend to have the same labels), while few discussions are made in those that are less homophilous. Recently, there have been many works on homogeneous graphs with heterophily. However, due to heterogeneity, it is non-trivial to extend their approach to deal with HGs with heterophily. In this work, based on empirical observations, we propose a meta-path-induced metric to measure the homophily degree of a HG. We also find that current HGNNs may have degenerated performance when handling HGs with less homophilous properties. Thus it is essential to increase the generalization ability of HGNNs on non-homophilous HGs. To this end, we propose HDHGR, a homophily-oriented deep heterogeneous graph rewiring approach that modifies the HG structure to increase the performance of HGNN. We theoretically verify HDHGR. In addition, experiments on real-world HGs demonstrate the effectiveness of HDHGR, which brings at most more than 10\

Benchmark Results

Tested on 4 datasets Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterophilic Graphs

Actor

Global leaderboard →

Default metric is Accuracy. The paper reports 0 values on Accuracy , 21 values on Macro-F1 and 21 values on Micro-F1 .

Sorted by Macro-F1. Highlighted rows are from other papers.

#ModelAccuracy ↑ defaultMacro-F1 ↑Micro-F1 ↑Paper
1
CTHGE
0.8258 ± 0.0039
—
—
2
HGT HDHGR
—
0.7725 ± 0.0053
0.8406 ± 0.0029
Accuracy —
Micro-F1 0.8406 ± 0.0029
This paper
3
PSHGCN
0.7620 ± 0.0128
—
—
4
HGT origin
—
0.7558 ± 0.0048
0.8297 ± 0.0029
Accuracy —
Micro-F1 0.8297 ± 0.0029
This paper
5
SHGN HDHGR
—
0.7273 ± 0.0035
0.8136 ± 0.0037
Accuracy —
Micro-F1 0.8136 ± 0.0037
This paper
6
SHGN origin
—
0.7166 ± 0.0162
0.8085 ± 0.0029
Accuracy —
Micro-F1 0.8085 ± 0.0029
This paper
7
HAN HDHGR
—
0.7113 ± 0.0138
0.8089 ± 0.0039
Accuracy —
Micro-F1 0.8089 ± 0.0039
This paper
10
GCN HDHGR
—
0.6721 ± 0.0094
0.7507 ± 0.0038
Accuracy —
Micro-F1 0.7507 ± 0.0038
This paper
11
HDHGR
—
0.6721 ± 0.0094
0.7507 ± 0.0038
Accuracy —
Micro-F1 0.7507 ± 0.0038
This paper
13
GAT HDHGR
—
0.6383 ± 0.0056
0.7423 ± 0.0028
Accuracy —
Micro-F1 0.7423 ± 0.0028
This paper
14
LINKX HDHGR
—
0.6379 ± 0.0205
0.7023 ± 0.0183
Accuracy —
Micro-F1 0.7023 ± 0.0183
This paper
15
H2GCN HDHGR
—
0.6267 ± 0.0113
0.7266 ± 0.0051
Accuracy —
Micro-F1 0.7266 ± 0.0051
This paper
16
IDGL
—
0.5964 ± 0.0171
0.6591 ± 0.0273
Accuracy —
Micro-F1 0.6591 ± 0.0273
This paper
17
HGSL
—
0.5835 ± 0.0123
0.6326 ± 0.0254
Accuracy —
Micro-F1 0.6326 ± 0.0254
This paper
18
LINKX origin
—
0.5798 ± 0.0201
0.6397 ± 0.0177
Accuracy —
Micro-F1 0.6397 ± 0.0177
This paper
19
LDS
—
0.5622 ± 0.0324
0.6235 ± 0.0289
Accuracy —
Micro-F1 0.6235 ± 0.0289
This paper
20
GCN origin
—
0.5538 ± 0.0032
0.6579 ± 0.0021
Accuracy —
Micro-F1 0.6579 ± 0.0021
This paper
21
HAN origin
—
0.5478 ± 0.0154
0.6895 ± 0.0026
Accuracy —
Micro-F1 0.6895 ± 0.0026
This paper
22
RGCN HDHGR
—
0.5333 ± 0.0158
0.7483 ± 0.0039
Accuracy —
Micro-F1 0.7483 ± 0.0039
This paper
25
H2GCN origin
—
0.4970 ± 0.0067
0.6365 ± 0.0076
Accuracy —
Micro-F1 0.6365 ± 0.0076
This paper
26
RGCN origin
—
0.4921 ± 0.0248
0.7161 ± 0.0082
Accuracy —
Micro-F1 0.7161 ± 0.0082
This paper
27
GCN
0.4878 ± 0.0130
—
—
29
GAT origin
—
0.4578 ± 0.0100
0.6091 ± 0.0058
Accuracy —
Micro-F1 0.6091 ± 0.0058
This paper
31
OriMetapath
—
0.4218 ± 0.0046
0.5851 ± 0.0021
Accuracy —
Micro-F1 0.5851 ± 0.0021
This paper

Heterogeneous Graph Benchmarks

#ModelMicro-F1 ↑Paper
1
LMSPS
0.9566 ±0.0020
2
PSHGCN
0.9561 ±0.0012
3
RpHGNN
0.9555 ±0.0029
15
SHGN (HDHGR)
0.9473 ±0.0016
This paper
18
GAT (HDHGR)
0.9470 ±0.0011
This paper
21
GCN
0.9460 ±0.0031
38
LINKX (HDHGR)
0.9369 ±0.0026
This paper
53
H2GCN (HDHGR)
0.9277 ±0.0031
This paper
54
RGCN (HDHGR)
0.9259 ±0.0063
This paper
56
HAN (HDHGR)
0.9257 ±0.0056
This paper
67
GCN (HDHGR)
0.9201 ±0.0010
This paper
176
MLP
0.6447 ±0.0136

ACM

Global leaderboard →

Default metric is Micro-F1. The paper reports 6 values on Micro-F1 and 8 values on Macro-F1 .

#ModelMicro-F1 ↑ defaultMacro-F1 ↑Paper
1
LMSPS
0.9469 ± 0.0036
—
2
PSHGCN
0.9427 ± 0.0023
—
3
SlotGAT
0.9406 ± 0.0022
—
12
SHGN
0.9335 ± 0.0045
0.9342 ± 0.0044
Macro-F1 0.9342 ± 0.0044
This paper
18
HDHGR
0.9280 ± 0.0025
0.9287 ± 0.0024
Macro-F1 0.9287 ± 0.0024
This paper
19
GAT
—
0.9226 ± 0.0094
Macro-F1 0.9226 ± 0.0094
This paper
29
GCN
—
0.9217 ± 0.0024
Macro-F1 0.9217 ± 0.0024
This paper
43
HAN
0.9147 ±0.0022
best reported
0.9089 ± 0.0043
Macro-F1 0.9089 ± 0.0043
paper 0.9079 ±0.0043
best at pub: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.9079 ±0.0043 Δ today 0.0068
44
RGCN
0.9141 ± 0.0075
0.9155 ± 0.0074
Macro-F1 0.9155 ± 0.0074
This paper
49
GIN
0.9092
—
73
H2GCN
0.8863 ± 0.0048
0.8879 ± 0.0045
Macro-F1 0.8879 ± 0.0045
This paper
96
LINKX
0.8480 ± 0.0038
0.8475 ± 0.0038
Macro-F1 0.8475 ± 0.0038
This paper
109
MLP
0.7102 ± 0.0221
—
#ModelMicro-F1 ↑Paper
1
ELLA
0.7930 ±0.0010
2
MHGCN
0.7820 ±0.0138
3
PSHGCN
0.7446 ±0.0032
14
GCN
0.6813 ±0.0083
58
HAN HDHGR
0.5932 ±0.0053
This paper
60
GCN HDHGR
0.5897 ±0.0041
This paper
62
GAT HDHGR
0.5799 ±0.0216
This paper
66
GCN origin
0.5684 ±0.0266
This paper
67
SHGN HDHGR
0.5656 ±0.0048
This paper
70
H2GCN HDHGR
0.5603 ±0.0024
This paper
71
GAT origin
0.5582 ±0.0211
This paper
72
HAN origin
0.5581 ±0.0169
This paper
73
RGCN HDHGR
0.5545 ±0.0071
This paper
74
MLP
0.5514
76
H2GCN origin
0.5429 ±0.0062
This paper
79
HGT HDHGR
0.5293 ±0.0162
This paper
80
RGCN origin
0.5251 ±0.0267
This paper
81
SHGN origin
0.5250 ±0.0091
This paper
84
HGT origin
0.5088 ±0.0041
This paper
90
LINKX HDHGR
0.4830 ±0.0085
This paper
96
LINKX origin
0.4411 ±0.0112
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere