Generative-Contrastive Heterogeneous Graph Neural Network
Abstract
Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs Neural Networks (HGNNs) have shown great potential in utilizing data augmentation and contrastive discriminators for downstream tasks. However, data augmentation remains limited due to the graph data's integrity. Furthermore, the contrastive discriminators suffer from sampling bias and lack local heterogeneous information. To tackle the above limitations, we propose a novel Generative-Contrastive Heterogeneous Graph Neural Network (GC-HGNN). Specifically, we propose a heterogeneous graph generative learning method that enhances CL-based paradigm. This paradigm includes: 1) A contrastive view augmentation strategy using a masked autoencoder. 2) Position-aware and semantics-aware positive sample sampling strategy for generating hard negative samples. 3) A hierarchical contrastive learning strategy aimed at capturing local and global information. Furthermore, the hierarchical contrastive learning and sampling strategies aim to constitute an enhanced contrastive discriminator under the generative-contrastive perspective. Finally, we compare our model with seventeen baselines on eight real-world datasets. Our model outperforms the latest baselines on node classification and link prediction tasks. To reproduce our work, we have open-sourced our code at https://github.com/wangyu0627/GC-HGNN.
Benchmark Results
Tested on 3 datasets 17 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Heterogeneous Graph Benchmarks
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9566
±0.0020 | |
| 2 | PSHGCN | 0.9561
±0.0012 | |
| 3 | RpHGNN | 0.9555
±0.0029 | |
| 7 | MHGCN | 0.9520
±0.0203 best reported | best at pub: Multiplex Heterogeneous Graph Convolutional Network (KDD 2022) |
| 21 | GCN | 0.9460
±0.0031 | |
| 37 | HAN | 0.9369 best reported | |
| 39 | HGT | 0.9365 best reported | |
| 41 | HGMAE | 0.9340
±0.0060 best reported | best at pub: HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networks (WWW 2023) best today: Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective (NeurIPS 2024) |
| 44 | DMGI | 0.9331 best reported | |
| 45 | HGCML | 0.9329
±0.0012 best reported | best at pub: Heterogeneous Graph Contrastive Multi-view Learning (2022) |
| 47 | Mp2vec | 0.9304 best reported | |
| 48 | GC-HGNN | 0.9301
±0.0030 | This paper |
| 62 | HeCo | 0.9224
±0.0048 best reported | best at pub: Heterogeneous Graph Contrastive Multi-view Learning (2022) |
| 75 | HERec | 0.9075
±0.0039 best reported | best at pub: Heterogeneous Graph Contrastive Multi-view Learning (2022) Difference within reported uncertainty; not counted as underperformance. |
| 81 | DeepWalk | 0.9012
±0.0045 | prev best: Heterogeneous Graph Contrastive Multi-view Learning (2022) |
| 176 | MLP | 0.6447
±0.0136 |
| # | Model | Macro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | ConCH | 0.6475 | |
| 2 | HetGNN | 0.6292 | |
| 3 | GC-HGNN | 0.6247
±0.0042 | This paper |
| 5 | HGT | 0.6176 best reported | |
| 7 | GCN | 0.6090 | |
| 8 | HGMAE | 0.6082
±0.0051 | This paper |
| 10 | HAN | 0.6011 best reported | |
| 11 | HeCo | 0.5987
±0.0033 | This paper |
| 13 | HERec | 0.5946
±0.0116 | This paper |
| 14 | DeepWalk | 0.5920
±0.0050 | This paper |
| 15 | HGCML | 0.5892
±0.0257 | This paper |
| 16 | Mp2vec | 0.5750 best reported | |
| 18 | MHGCN | 0.5712
±0.0032 | This paper |
| 19 | DMGI | 0.5599
±0.0059 | This paper |
