Long-range Meta-path Search on Large-scale Heterogeneous Graphs
Abstract
Utilizing long-range dependency, a concept extensively studied in homogeneous graphs, remains underexplored in heterogeneous graphs, especially on large ones, posing two significant challenges: Reducing computational costs while maximizing effective information utilization in the presence of heterogeneity, and overcoming the over-smoothing issue in graph neural networks. To address this gap, we investigate the importance of different meta-paths and introduce an automatic framework for utilizing long-range dependency on heterogeneous graphs, denoted as Long-range Meta-path Search through Progressive Sampling (LMSPS). Specifically, we develop a search space with all meta-paths related to the target node type. By employing a progressive sampling algorithm, LMSPS dynamically shrinks the search space with hop-independent time complexity. Through a sampling evaluation strategy, LMSPS conducts a specialized and effective meta-path selection, leading to retraining with only effective meta-paths, thus mitigating costs and over-smoothing. Extensive experiments across diverse heterogeneous datasets validate LMSPS's capability in discovering effective long-range meta-paths, surpassing state-of-the-art methods. Our code is available at.
Benchmark Results
Tested on 5 datasets 4 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
OGB
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS+LP+MS | 0.5784
±0.0022 | This paper |
| 2 | SeHGNN+emb+ms | 0.5719
±0.0012 | |
| 4 | SeHGNN+LP+MS | 0.5671
±0.0014 | This paper |
| 3 | SeHGNN+ms | 0.5671
±0.0014 | |
| 9 | LMSPS+LP | 0.5510
±0.0011 | This paper |
| 10 | LMSPS | 0.5483
±0.0020 | This paper |
| 19 | SeHGNN | 0.5399
±0.0018 best reported | best at pub: Simple and Efficient Heterogeneous Graph Neural Network (AAAI 2022) |
| 20 | SeHGNN+LP | 0.5399
±0.0018 | This paper |
| 28 | NARS | 0.5240
±0.0016 best reported | best at pub: Graph Attention MLP with Reliable Label Utilization (2021) best today: SCR: Training Graph Neural Networks with Consistency Regularization (2021) |
| 35 | GAMLP+LP | 0.5163
±0.0022 | This paper |
| 38 | SAGN+LP | 0.5117
±0.0032 | This paper |
| 42 | HGT | 0.5023
±0.0048 best reported | best at pub: Graph Attention MLP with Reliable Label Utilization (2021) |
| 48 | RGCN | 0.4811
±0.0048 best reported | best at pub: Heterogeneous Graph Representation Learning with Relation Awareness (2021) best today: Efficient Heterogeneous Graph Learning via Random Projection (2023) Difference within reported uncertainty; not counted as underperformance. |
| 57 | GraphSAGE | 0.4646
±0.0060 | |
| 67 | Random | 0.3707
±0.0020 best reported | best today: Towards Efficient Training of Graph Neural Networks: A Multiscale Approach (TMLR 2025) Difference within reported uncertainty; not counted as underperformance. |
| 76 | MLP | 0.3243 |
Heterogeneous Graph Benchmarks
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9566
±0.0020 | This paper |
| 2 | PSHGCN | 0.9561
±0.0012 | |
| 3 | RpHGNN | 0.9555
±0.0029 | |
| 5 | SeHGNN | 0.9542
±0.0017 best reported | best at pub: Simple and Efficient Heterogeneous Graph Neural Network (AAAI 2022) best today: Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials (WWW 2023) Difference within reported uncertainty; not counted as underperformance. |
| 6 | SlotGAT | 0.9531
±0.0019 | This paper |
| 8 | PMMM | 0.9514
±0.0022 | This paper |
| 19 | space4HGNN | 0.9463
±0.0040 | This paper |
| 20 | NARS | 0.9461
±0.0042 | prev best: Multiplex Heterogeneous Graph Convolutional Network (KDD 2022) |
| 21 | GCN | 0.9460
±0.0031 | |
| 27 | GraphMSE | 0.9444
±0.0013 | This paper |
| 30 | DiffMG | 0.9420
±0.0036 | This paper |
| 34 | Random | 0.9384
±0.0053 | This paper |
| 176 | MLP | 0.6447
±0.0136 |
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9469
±0.0036 | This paper |
| 2 | PSHGCN | 0.9427
±0.0023 | |
| 3 | SlotGAT | 0.9406
±0.0022 | This paper |
| 5 | SeHGNN | 0.9398
±0.0036 best reported | best at pub: Simple and Efficient Heterogeneous Graph Neural Network (AAAI 2022) best today: Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials (WWW 2023) Difference within reported uncertainty; not counted as underperformance. |
| 7 | HINormer | 0.9383
±0.0045 | This paper |
| 8 | PMMM | 0.9371
±0.0017 | This paper |
| 14 | NARS | 0.9331
±0.0033 | This paper |
| 23 | GraphMSE | 0.9254
±0.0014 | This paper |
| 25 | space4HGNN | 0.9238
±0.0010 | This paper |
| 29 | GCN | 0.9229 | |
| 50 | Random | 0.9082
±0.0093 | This paper |
| 78 | DiffMG | 0.8807
±0.0304 | This paper |
| 109 | MLP | 0.7102
±0.0221 |
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | ELLA | 0.7930
±0.0010 | |
| 2 | MHGCN | 0.7820
±0.0138 | |
| 3 | PSHGCN | 0.7446
±0.0032 | |
| 5 | SeHGNN | 0.7342
±0.0047 best reported | best at pub: Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials (WWW 2023) |
| 10 | LMSPS | 0.6870
±0.0026 | This paper |
| 11 | SlotGAT | 0.6864
±0.0033 | This paper |
| 14 | GCN | 0.6813
±0.0083 | |
| 16 | HINormer | 0.6783
±0.0034 | This paper |
| 19 | PMMM | 0.6758
±0.0022 | This paper |
| 28 | NARS | 0.6618
±0.0070 | prev best: Multiplex Heterogeneous Graph Convolutional Network (KDD 2022) |
| 39 | space4HGNN | 0.6396
±0.0043 | This paper |
| 46 | GraphMSE | 0.6237
±0.0103 | This paper |
| 56 | DiffMG | 0.5975
±0.0123 | This paper |
| 74 | MLP | 0.5514 | |
| 77 | Random | 0.5383
±0.0066 | This paper |
| # | Model | Macro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | ConCH | 0.6475 | |
| 2 | HetGNN | 0.6292 | |
| 3 | GC-HGNN | 0.6247
±0.0042 | |
| 7 | GCN | 0.6090 | |
| 21 | LMSPS | 0.5326
±0.0047 | This paper |
| 22 | HINormer | 0.5218
±0.0039 | This paper |
| 23 | SeHGNN | 0.5187
±0.0086 best reported | best at pub: Simple and Efficient Heterogeneous Graph Neural Network (AAAI 2022) Difference within reported uncertainty; not counted as underperformance. |
| 26 | NARS | 0.4998
±0.0177 | This paper |
| 27 | SlotGAT | 0.4968
±0.0197 | This paper |
| 35 | space4HGNN | 0.4137
±0.0449 | This paper |
| 43 | Random | 0.2122
±0.0258 | This paper |
