Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning
Abstract
Unsupervised Multiplex Graph Learning (UMGL) aims to learn node representations on various edge types without manual labeling. However, existing research overlooks a key factor: the reliability of the graph structure. Real-world data often exhibit a complex nature and contain abundant task-irrelevant noise, severely compromising UMGL's performance. Moreover, existing methods primarily rely on contrastive learning to maximize mutual information across different graphs, limiting them to multiplex graph redundant scenarios and failing to capture view-unique task-relevant information. In this paper, we focus on a more realistic and challenging task: to unsupervisedly learn a fused graph from multiple graphs that preserve sufficient task-relevant information while removing task-irrelevant noise. Specifically, our proposed Information-aware Unsupervised Multiplex Graph Fusion framework (InfoMGF) uses graph structure refinement to eliminate irrelevant noise and simultaneously maximizes view-shared and view-unique task-relevant information, thereby tackling the frontier of non-redundant multiplex graph. Theoretical analyses further guarantee the effectiveness of InfoMGF. Comprehensive experiments against various baselines on different downstream tasks demonstrate its superior performance and robustness. Surprisingly, our unsupervised method even beats the sophisticated supervised approaches. The source code and datasets are available at https://github.com/zxlearningdeep/InfoMGF.
Benchmark Results
Tested on 2 datasets 6 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Heterogeneous Graph Benchmarks
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9566
±0.0020 | |
| 2 | PSHGCN | 0.9561
±0.0012 | |
| 3 | RpHGNN | 0.9555
±0.0029 | |
| 21 | GCN | 0.9460
±0.0031 best reported | best at pub: Graph Neural Networks with a Distribution of Parametrized Graphs (ICML 2023) |
| 23 | GAT | 0.9448
±0.0022 best reported | best at pub: Graph Neural Networks with a Distribution of Parametrized Graphs (ICML 2023) |
| 37 | HAN | 0.9369 best reported | |
| 46 | GraphSAGE | 0.9306
±0.0047 | |
| 64 | HDMI | 0.9220
±0.0050 best reported | best at pub: HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networks (WWW 2023) best today: Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective (NeurIPS 2024) |
| 65 | InfoMGF-LA | 0.9212
±0.0028 | This paper |
| 68 | InfoMGF-RA | 0.9193
±0.0029 | This paper |
| 69 | SUBLIME | 0.9182
±0.0027 | This paper |
| 71 | BTGF | 0.9157
±0.0021 | This paper |
| 73 | DMG | 0.9134
±0.0049 | This paper |
| 76 | GEN | 0.9065
±0.0071 | This paper |
| 77 | IDGL | 0.9061
±0.0056 | This paper |
| 84 | GRCN | 0.8943
±0.0044 | This paper |
| 85 | LDS | 0.8874
±0.0085 | This paper |
| 106 | ProGNN | 0.8483
±0.0136 | This paper |
| 131 | NodeFormer | 0.8056
±0.0062 | This paper |
| 146 | GSR | 0.7769
±0.0042 | This paper |
| 151 | STABLE | 0.7642
±0.0195 | This paper |
| 176 | MLP | 0.6447
±0.0136 |
| # | Model | Micro-F1 ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS | 0.9469
±0.0036 | |
| 2 | PSHGCN | 0.9427
±0.0023 | |
| 3 | SlotGAT | 0.9406
±0.0022 | |
| 10 | InfoMGF-LA | 0.9335
±0.0021 | This paper |
| 15 | InfoMGF-RA | 0.9314
±0.0021 | This paper |
| 17 | GRCN | 0.9294
±0.0018 | This paper |
| 19 | GAT | 0.9273 best reported | best at pub: Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphs (NeurIPS 2020) |
| 29 | GCN | 0.9229 best reported | best at pub: Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphs (NeurIPS 2020) |
| 33 | SUBLIME | 0.9213
±0.0037 | This paper |
| 34 | GSR | 0.9211
±0.0099 | This paper |
| 36 | LDS | 0.9205
±0.0026 | This paper |
| 39 | IDGL | 0.9163
±0.0124 | This paper |
| 40 | BTGF | 0.9162
±0.0011 | This paper |
| 43 | HAN | 0.9147
±0.0022 | prev best: Heterogeneous Graph Benchmarks (KDD 2021) |
| 47 | HDMI | 0.9116
±0.0056 best reported | best at pub: HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networks (WWW 2023) Difference within reported uncertainty; not counted as underperformance. |
| 49 | GIN | 0.9092 | |
| 54 | NodeFormer | 0.9060
±0.0095 | This paper |
| 58 | ProGNN | 0.9050
±0.0129 | This paper |
| 61 | DMG | 0.9031
±0.0035 | This paper |
| 82 | GEN | 0.8788
±0.0261 | This paper |
| 98 | STABLE | 0.8338
±0.0451 | This paper |
| 109 | MLP | 0.7102
±0.0221 |
