KDD 2022

Multiplex Heterogeneous Graph Convolutional Network

Pengyang Yu, Chaofan Fu, Yanwei Yu, Chao Huang, Zhongying Zhao, Junyu Dong

Main figure for Multiplex Heterogeneous Graph Convolutional Network

Abstract

Heterogeneous graph convolutional networks have gained great popularity in tackling various network analytical tasks on heterogeneous network data, ranging from link prediction to node classification. However, most existing works ignore the relation heterogeneity with multiplex network between multi-typed nodes and different importance of relations in meta-paths for node embedding, which can hardly capture the heterogeneous structure signals across different relations. To tackle this challenge, this work proposes a ultiplex eterogeneous raph onvolutional etwork (MHGCN) for heterogeneous network embedding. Our MHGCN can automatically learn the useful heterogeneous meta-path interactions of different lengths in multiplex heterogeneous networks through multi-layer convolution aggregation. Additionally, we effectively integrate both multi-relation structural signals and attribute semantics into the learned node embeddings with both unsupervised and semi-supervised learning paradigms. Extensive experiments on five real-world datasets with various network analytical tasks demonstrate the significant superiority of MHGCN against state-of-the-art embedding baselines in terms of all evaluation metrics. The source code of our method is available at:.

Proposed method: MHGCN

Benchmark Results

Tested on 2 datasets 10 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

#ModelMicro-F1 ↑Paper
1
LMSPS
0.9566 ±0.0020
2
PSHGCN
0.9561 ±0.0012
3
RpHGNN
0.9555 ±0.0029
7
MHGCN
0.9520 ±0.0203
This paper
20
NARS
actual #20 vs paper #133 113 places worse
0.9461 ±0.0042
best reported
actual #20 vs paper #133 113 places worse
paper 0.8040 ±0.0320
paper 0.8040 ±0.0320 Δ today 0.1421
21
GCN
0.9460 ±0.0031
22
MAGNN
actual #22 vs paper #83 61 places worse
0.9456
best reported
actual #22 vs paper #83 61 places worse
paper 0.8950 ±0.0396
paper 0.8950 ±0.0396 Δ at pub 0.0506
32
GTN
actual #32 vs paper #89 57 places worse
0.9417 ±0.0026
best reported
actual #32 vs paper #89 57 places worse
paper 0.8680 ±0.0125
best at pub: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.8680 ±0.0125 Δ at pub 0.0717 Δ today 0.0737
37
HAN
actual #37 vs paper #124 87 places worse
0.9369
best reported
actual #37 vs paper #124 87 places worse
paper 0.8130 ±0.0100
44
DMGI
actual #44 vs paper #141 97 places worse
0.7870 ±0.0235
actual #44 vs paper #141 97 places worse
paper 0.7870 ±0.0235

Improvement within reported uncertainty; not highlighted.

paper 0.7870 ±0.0235 Δ at pub 0.0020 Δ today 0.1461
52
Node2Vec
actual #52 vs paper #191 139 places worse
0.9282
best reported
actual #52 vs paper #191 139 places worse
paper 0.3510 ±0.0112
paper 0.3510 ±0.0112 Δ at pub 0.5772
78
HGSL
0.9020 ±0.0396
This paper
86
AM-GCN
0.8780 ±0.0112
This paper
89
R-GCN
actual #89 vs paper #89
0.8700 ±0.0070
actual #89 vs paper #89
paper 0.8700 ±0.0070
paper 0.8700 ±0.0070 Δ at pub 0.1799
90
FAME
0.8680 ±0.0127
This paper
117
HPN
0.8300 ±0.0201
This paper
176
MLP
0.6447 ±0.0136
177
SGC
actual #177 vs paper #177
0.6230 ±0.0009
actual #177 vs paper #177
paper 0.6230 ±0.0009
paper 0.6230 ±0.0009 Δ at pub 0.0864
189
MNE
0.3840 ±0.0109
This paper
190
FastRP
0.3750 ±0.0199
This paper
191
RandNE
0.3720 ±0.0150
This paper
#ModelMicro-F1 ↑Paper
1
ELLA
0.7930 ±0.0010
2
MHGCN
0.7820 ±0.0138
This paper
3
PSHGCN
0.7446 ±0.0032
13
GTN
actual #13 vs paper #48 35 places worse
0.6827 ±0.0065
best reported
actual #13 vs paper #48 35 places worse
paper 0.6160 ±0.0093
best at pub: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6160 ±0.0093 Δ at pub 0.0354 Δ today 0.0667
14
GCN
0.6813 ±0.0083
17
MAGNN
actual #17 vs paper #48 31 places worse
0.6782 ±0.0154
best reported
actual #17 vs paper #48 31 places worse
paper 0.6150 ±0.0089
best at pub: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6150 ±0.0089 Δ at pub 0.0317 Δ today 0.0632
18
HAN
actual #18 vs paper #66 48 places worse
0.6769 ±0.0064
best reported
actual #18 vs paper #66 48 places worse
paper 0.5680 ±0.0078
best at pub: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.5680 ±0.0078 Δ at pub 0.0783 Δ today 0.1089
28
NARS
actual #28 vs paper #63 35 places worse
0.6618 ±0.0070
best reported
actual #28 vs paper #63 35 places worse
paper 0.5740 ±0.0048
paper 0.5740 ±0.0048 Δ today 0.0878
33
DMGI
actual #33 vs paper #75 42 places worse
0.6480
best reported
actual #33 vs paper #75 42 places worse
paper 0.5440 ±0.0189
best at pub: Implicit Graph Neural Networks (NeurIPS 2020)
paper 0.5440 ±0.0189 Δ at pub 0.1040 Δ today 0.1040
38
AM-GCN
0.6400 ±0.0013
This paper
40
HGSL
0.6380 ±0.0030
This paper
47
R-GCN
actual #47 vs paper #63 16 places worse
0.6214 ±0.0066
best reported
actual #47 vs paper #63 16 places worse
paper 0.5720 ±0.0145
paper 0.5720 ±0.0145 Δ at pub 0.0494
57
FAME
0.5940 ±0.0143
This paper
61
HPN
0.5840 ±0.0021
This paper
69
SGC
0.5630 ±0.0133
This paper
74
MLP
0.5514
75
Node2Vec
actual #75 vs paper #102 27 places worse
0.5476 ±0.0063
best reported
actual #75 vs paper #102 27 places worse
paper 0.3820 ±0.0703
paper 0.3820 ±0.0703 Δ at pub 0.1656
100
RandNE
0.3920 ±0.0185
This paper
103
MNE
0.3820 ±0.0680
This paper
104
FastRP
0.3810 ±0.0140
This paper
108
GATNE
0.3330 ±0.0005
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere