Heterogeneous Graph Representation Learning with Relation Awareness

Le Yu, Leilei Sun, Bowen Du, Chuanren Liu, Weifeng Lv, Hui Xiong

Main figure for Heterogeneous Graph Representation Learning with Relation Awareness

Abstract

Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are primarily developed by following the propagation mechanism of node representations. There are few efforts on studying the role of relations for improving the learning of more fine-grained node representations. Indeed, it is important to collaboratively learn the semantic representations of relations and discern node representations with respect to different relation types. To this end, in this paper, we propose a Relation-aware Heterogeneous Graph Neural Network, namely R-HGNN, to learn node representations on heterogeneous graphs at a fine-grained level by considering relation-aware characteristics. Specifically, a dedicated graph convolution component is first designed to learn unique node representations from each relation-specific graph separately. Then, a cross-relation message passing module is developed to improve the interactions of node representations across different relations. Also, the relation representations are learned in a layer-wise manner to capture relation semantics, which are used to guide the node representation learning process. Moreover, a semantic fusing module is presented to aggregate relation-aware node representations into a compact representation with the learned relation representations. Finally, we conduct extensive experiments on a variety of graph learning tasks, and experimental results demonstrate that our approach consistently outperforms existing methods among all the tasks.

Proposed method: R-HGNN

Benchmark Results

Tested on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

OGB

#ModelAccuracy ↑Paper
1
LMSPS+LP+MS
0.5784 ±0.0022
2
SeHGNN+emb+ms
0.5719 ±0.0012
3
SeHGNN+ms
0.5671 ±0.0014
33
R-HGNN
0.5204
This paper
42
HGT
actual #42 vs paper #45 3 places worse
0.5023 ±0.0048
best reported
actual #42 vs paper #45 3 places worse
paper 0.4921
47
GAT
actual #47 vs paper #64 17 places worse
0.4860 ±0.0029
best reported
actual #47 vs paper #64 17 places worse
paper 0.3767
48
RGCN
actual #48 vs paper #48
0.4811 ±0.0048
best reported
actual #48 vs paper #48
paper 0.4796

Difference within reported uncertainty; not counted as underperformance.

paper 0.4796 Δ today 0.0015
50
HetSANN
0.4781
This paper
54
RSHN
0.4728
This paper
57
GraphSAGE
actual #57 vs paper #67 10 places worse
0.3704
actual #57 vs paper #67 10 places worse
paper 0.3704
60
GCN
actual #60 vs paper #71 11 places worse
0.3487
actual #60 vs paper #71 11 places worse
paper 0.3487
66
GIN
0.3732 ±0.0033
76
MLP
actual #76 vs paper #76
0.3243
actual #76 vs paper #76
paper 0.3243

Heterogeneous Graph Benchmarks

#ModelMicro-F1 ↑Paper
1
ELLA
0.7930 ±0.0010
2
MHGCN
0.7820 ±0.0138
3
PSHGCN
0.7446 ±0.0032
14
GCN
actual #14 vs paper #55 41 places worse
0.6813 ±0.0083
best reported
actual #14 vs paper #55 41 places worse
paper 0.5975
15
GAT
actual #15 vs paper #48 33 places worse
0.6808 ±0.0049
best reported
actual #15 vs paper #48 33 places worse
paper 0.6197
18
HAN
actual #18 vs paper #43 25 places worse
0.6298
actual #18 vs paper #43 25 places worse
paper 0.6298
prev best: Implicit Graph Neural Networks (NeurIPS 2020)
paper 0.6298 Δ at pub 0.0228 Δ today 0.0471
24
HGT
actual #24 vs paper #40 16 places worse
0.6720 ±0.0057
best reported
actual #24 vs paper #40 16 places worse
paper 0.6365
paper 0.6365 Δ today 0.0355
26
RGCN
actual #26 vs paper #40 14 places worse
0.6651 ±0.0028
best reported
actual #26 vs paper #40 14 places worse
paper 0.6359
35
RSHN
actual #35 vs paper #41 6 places worse
0.6422 ±0.0103
best reported
actual #35 vs paper #41 6 places worse
paper 0.6337

Difference within reported uncertainty; not counted as underperformance.

paper 0.6337 Δ today 0.0085
36
R-HGNN
0.6417
This paper
44
GraphSAGE
0.6276
This paper
53
HetSANN
0.6069
This paper
74
MLP
0.5514
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported value improved over the best known when published Improved at pub — later paper surpassed this result Best today — OK at publication; today's leaderboard best is elsewhere