Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials
Abstract
Heterogeneous Graph Neural Networks (HGNNs) have gained significant popularity in various heterogeneous graph learning tasks. However, most existing HGNNs rely on spatial domain-based methods to aggregate information, i.e., manually selected meta-paths or some heuristic modules, lacking theoretical guarantees. Furthermore, these methods cannot learn arbitrary valid heterogeneous graph filters within the spectral domain, which have limited expressiveness. To tackle these issues, we present a positive spectral heterogeneous graph convolution via positive noncommutative polynomials. Then, using this convolution, we propose PSHGCN, a novel Positive Spectral Heterogeneous Graph Convolutional Network. PSHGCN offers a simple yet effective method for learning valid heterogeneous graph filters. Moreover, we demonstrate the rationale of PSHGCN in the graph optimization framework. We conducted an extensive experimental study to show that PSHGCN can learn diverse heterogeneous graph filters and outperform all baselines on open benchmarks. Notably, PSHGCN exhibits remarkable scalability, efficiently handling large real-world graphs comprising millions of nodes and edges. Our codes are available at.
Benchmark Results
Tested on 3 datasets 1 baseline value reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Heterogeneous Graph Benchmarks
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9566
±0.0020 | |
| 2 | PSHGCN | 0.9561
±0.0012 | This paper |
| 3 | RpHGNN | 0.9555
±0.0029 | |
| 5 | SeHGNN | 0.9542
±0.0017 | This paper |
| 7 | MHGCN | 0.9520
±0.0203 best reported | best at pub: Multiplex Heterogeneous Graph Convolutional Network (KDD 2022) Difference within reported uncertainty; not counted as underperformance. |
| 21 | GCN | 0.9460
±0.0031 | |
| 49 | ChebNetII | 0.9297
±0.0048 | This paper |
| 51 | HALO | 0.9284
±0.0034 | This paper |
| 55 | EMRGNN | 0.9257
±0.0037 | This paper |
| 60 | GPRGNN | 0.9245
±0.0076 | prev best: Mixed Graph Contrastive Network for Semi-Supervised Node Classification (2022) |
| 176 | MLP | 0.6447
±0.0136 |
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9469
±0.0036 | |
| 2 | PSHGCN | 0.9427
±0.0023 | This paper |
| 3 | SlotGAT | 0.9406
±0.0022 | |
| 5 | SeHGNN | 0.9398
±0.0036 | This paper |
| 6 | EMRGNN | 0.9385
±0.0033 | This paper |
| 16 | HALO | 0.9296
±0.0033 | This paper |
| 27 | ChebNetII | 0.9233
±0.0038 | This paper |
| 29 | GCN | 0.9229 | |
| 30 | GPRGNN | 0.9228
±0.0027 | prev best: Mixed Graph Contrastive Network for Semi-Supervised Node Classification (2022) |
| 37 | MHGCN | 0.9197
±0.0068 | This paper |
| 109 | MLP | 0.7102
±0.0221 |
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | ELLA | 0.7930
±0.0010 | |
| 2 | MHGCN | 0.7820
±0.0138 best reported | best at pub: Multiplex Heterogeneous Graph Convolutional Network (KDD 2022) |
| 3 | PSHGCN | 0.7446
±0.0032 | This paper |
| 4 | HALO | 0.7381
±0.0072 | This paper |
| 5 | SeHGNN | 0.7342
±0.0047 | prev best: Simple and Efficient Heterogeneous Graph Neural Network (AAAI 2022) |
| 6 | simpleHGN | 0.7083
±0.0107 | This paper |
| 8 | GPRGNN | 0.6883
±0.0095 | This paper |
| 9 | EMRGNN | 0.6876
±0.0078 | This paper |
| 12 | ChebNetII | 0.6833
±0.0092 | This paper |
| 13 | GTN | 0.6827
±0.0065 | prev best: Heterogeneous Graph Benchmarks (KDD 2021) |
| 14 | GCN | 0.6813
±0.0083 | prev best: Heterogeneous Graph Benchmarks (KDD 2021) |
| 15 | GAT | 0.6808
±0.0049 | prev best: Heterogeneous Graph Benchmarks (KDD 2021) |
| 17 | MAGNN | 0.6782
±0.0154 | prev best: Heterogeneous Graph Benchmarks (KDD 2021) |
| 18 | HAN | 0.6769
±0.0064 | prev best: Heterogeneous Graph Benchmarks (KDD 2021) |
| 26 | RGCN | 0.6651
±0.0028 | prev best: Heterogeneous Graph Representation Learning with Relation Awareness (2021) |
| 44 | GraphSAGE | 0.6276 | |
| 74 | MLP | 0.5514 |
