WWW 2023

Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials

Mingguo He, Zhewei Wei, Shikun Feng, Zhengjie Huang, Weibin Li, Yu Sun, Dianhai Yu

Main figure for Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials

Abstract

Heterogeneous Graph Neural Networks (HGNNs) have gained significant popularity in various heterogeneous graph learning tasks. However, most existing HGNNs rely on spatial domain-based methods to aggregate information, i.e., manually selected meta-paths or some heuristic modules, lacking theoretical guarantees. Furthermore, these methods cannot learn arbitrary valid heterogeneous graph filters within the spectral domain, which have limited expressiveness. To tackle these issues, we present a positive spectral heterogeneous graph convolution via positive noncommutative polynomials. Then, using this convolution, we propose PSHGCN, a novel Positive Spectral Heterogeneous Graph Convolutional Network. PSHGCN offers a simple yet effective method for learning valid heterogeneous graph filters. Moreover, we demonstrate the rationale of PSHGCN in the graph optimization framework. We conducted an extensive experimental study to show that PSHGCN can learn diverse heterogeneous graph filters and outperform all baselines on open benchmarks. Notably, PSHGCN exhibits remarkable scalability, efficiently handling large real-world graphs comprising millions of nodes and edges. Our codes are available at.

Proposed method: PSHGCN

Benchmark Results

Tested on 3 datasets 1 baseline value reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

#ModelMicro-F1 ↑Paper
1
LMSPS
0.9566 ±0.0020
2
PSHGCN
0.9561 ±0.0012
This paper
3
RpHGNN
0.9555 ±0.0029
5
SeHGNN
0.9542 ±0.0017
This paper
7
MHGCN
actual #7 vs paper #32 25 places worse
0.9520 ±0.0203
best reported
actual #7 vs paper #32 25 places worse
paper 0.9403 ±0.0043

Difference within reported uncertainty; not counted as underperformance.

paper 0.9403 ±0.0043 Δ at pub 0.0117
21
GCN
0.9460 ±0.0031
49
ChebNetII
0.9297 ±0.0048
This paper
51
HALO
0.9284 ±0.0034
This paper
55
EMRGNN
0.9257 ±0.0037
This paper
60
GPRGNN
actual #60 vs paper #60
0.9245 ±0.0076
actual #60 vs paper #60
paper 0.9245 ±0.0076
paper 0.9245 ±0.0076 Δ at pub 0.2461
176
MLP
0.6447 ±0.0136
#ModelMicro-F1 ↑Paper
1
LMSPS
0.9469 ±0.0036
2
PSHGCN
0.9427 ±0.0023
This paper
3
SlotGAT
0.9406 ±0.0022
5
SeHGNN
0.9398 ±0.0036
This paper
6
EMRGNN
0.9385 ±0.0033
This paper
16
HALO
0.9296 ±0.0033
This paper
27
ChebNetII
0.9233 ±0.0038
This paper
29
GCN
0.9229
30
GPRGNN
actual #30 vs paper #30
0.9228 ±0.0027
actual #30 vs paper #30
paper 0.9228 ±0.0027
paper 0.9228 ±0.0027 Δ at pub 0.1135
37
MHGCN
0.9197 ±0.0068
This paper
109
MLP
0.7102 ±0.0221
#ModelMicro-F1 ↑Paper
1
ELLA
0.7930 ±0.0010
2
MHGCN
actual #2 vs paper #6 4 places worse
0.7820 ±0.0138
best reported
actual #2 vs paper #6 4 places worse
paper 0.7028 ±0.0071
paper 0.7028 ±0.0071 Δ at pub 0.0792
3
PSHGCN
0.7446 ±0.0032
This paper
4
HALO
0.7381 ±0.0072
This paper
5
SeHGNN
actual #5 vs paper #5
0.7342 ±0.0047
actual #5 vs paper #5
paper 0.7342 ±0.0047
paper 0.7342 ±0.0047 Δ at pub 0.0425
6
simpleHGN
0.7083 ±0.0107
This paper
8
GPRGNN
0.6883 ±0.0095
This paper
9
EMRGNN
0.6876 ±0.0078
This paper
12
ChebNetII
0.6833 ±0.0092
This paper
13
GTN
actual #13 vs paper #13
0.6827 ±0.0065
actual #13 vs paper #13
paper 0.6827 ±0.0065
prev best: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6827 ±0.0065 Δ at pub 0.0313
14
GCN
actual #14 vs paper #14
0.6813 ±0.0083
actual #14 vs paper #14
paper 0.6813 ±0.0083
prev best: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6813 ±0.0083 Δ at pub 0.0331
15
GAT
actual #15 vs paper #15
0.6808 ±0.0049
actual #15 vs paper #15
paper 0.6808 ±0.0049
prev best: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6808 ±0.0049 Δ at pub 0.0322
17
MAGNN
actual #17 vs paper #17
0.6782 ±0.0154
actual #17 vs paper #17
paper 0.6782 ±0.0154
prev best: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6782 ±0.0154 Δ at pub 0.0315
18
HAN
actual #18 vs paper #18
0.6769 ±0.0064
actual #18 vs paper #18
paper 0.6769 ±0.0064
prev best: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6769 ±0.0064 Δ at pub 0.0306
26
RGCN
actual #26 vs paper #26
0.6651 ±0.0028
actual #26 vs paper #26
paper 0.6651 ±0.0028
paper 0.6651 ±0.0028 Δ at pub 0.0292
44
GraphSAGE
0.6276
74
MLP
0.5514
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published