NeurIPS 2024

Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning

Zhixiang Shen, Shuo Wang, Zhao Kang

Main figure for Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning

Abstract

Unsupervised Multiplex Graph Learning (UMGL) aims to learn node representations on various edge types without manual labeling. However, existing research overlooks a key factor: the reliability of the graph structure. Real-world data often exhibit a complex nature and contain abundant task-irrelevant noise, severely compromising UMGL's performance. Moreover, existing methods primarily rely on contrastive learning to maximize mutual information across different graphs, limiting them to multiplex graph redundant scenarios and failing to capture view-unique task-relevant information. In this paper, we focus on a more realistic and challenging task: to unsupervisedly learn a fused graph from multiple graphs that preserve sufficient task-relevant information while removing task-irrelevant noise. Specifically, our proposed Information-aware Unsupervised Multiplex Graph Fusion framework (InfoMGF) uses graph structure refinement to eliminate irrelevant noise and simultaneously maximizes view-shared and view-unique task-relevant information, thereby tackling the frontier of non-redundant multiplex graph. Theoretical analyses further guarantee the effectiveness of InfoMGF. Comprehensive experiments against various baselines on different downstream tasks demonstrate its superior performance and robustness. Surprisingly, our unsupervised method even beats the sophisticated supervised approaches. The source code and datasets are available at https://github.com/zxlearningdeep/InfoMGF.

Benchmark Results

Tested on 2 datasets 6 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

#ModelMicro-F1 ↑Paper
1
LMSPS
0.9566 ±0.0020
2
PSHGCN
0.9561 ±0.0012
3
RpHGNN
0.9555 ±0.0029
21
GCN
actual #21 vs paper #74 53 places worse
0.9460 ±0.0031
best reported
actual #21 vs paper #74 53 places worse
paper 0.9099 ±0.0028
paper 0.9099 ±0.0028 Δ at pub 0.0361
23
GAT
actual #23 vs paper #74 51 places worse
0.9448 ±0.0022
best reported
actual #23 vs paper #74 51 places worse
paper 0.9113 ±0.0040
paper 0.9113 ±0.0040 Δ at pub 0.0335
37
HAN
actual #37 vs paper #71 34 places worse
0.9369
best reported
actual #37 vs paper #71 34 places worse
paper 0.9147 ±0.0022
46
GraphSAGE
0.9306 ±0.0047
64
HDMI
actual #64 vs paper #74 10 places worse
0.9220 ±0.0050
best reported
actual #64 vs paper #74 10 places worse
paper 0.9089 ±0.0051
65
InfoMGF-LA
0.9212 ±0.0028
This paper
68
InfoMGF-RA
0.9193 ±0.0029
This paper
69
SUBLIME
0.9182 ±0.0027
This paper
71
BTGF
0.9157 ±0.0021
This paper
73
DMG
0.9134 ±0.0049
This paper
76
GEN
0.9065 ±0.0071
This paper
77
IDGL
0.9061 ±0.0056
This paper
84
GRCN
0.8943 ±0.0044
This paper
85
LDS
0.8874 ±0.0085
This paper
106
ProGNN
0.8483 ±0.0136
This paper
131
NodeFormer
0.8056 ±0.0062
This paper
146
GSR
0.7769 ±0.0042
This paper
151
STABLE
0.7642 ±0.0195
This paper
176
MLP
0.6447 ±0.0136
#ModelMicro-F1 ↑Paper
1
LMSPS
0.9469 ±0.0036
2
PSHGCN
0.9427 ±0.0023
3
SlotGAT
0.9406 ±0.0022
10
InfoMGF-LA
0.9335 ±0.0021
This paper
15
InfoMGF-RA
0.9314 ±0.0021
This paper
17
GRCN
0.9294 ±0.0018
This paper
19
GAT
actual #19 vs paper #43 24 places worse
0.9273
best reported
actual #19 vs paper #43 24 places worse
paper 0.9146 ±0.0062
paper 0.9146 ±0.0062 Δ at pub 0.0127
29
GCN
actual #29 vs paper #61 32 places worse
0.9229
best reported
actual #29 vs paper #61 32 places worse
paper 0.9018 ±0.0061
paper 0.9018 ±0.0061 Δ at pub 0.0211
33
SUBLIME
0.9213 ±0.0037
This paper
34
GSR
0.9211 ±0.0099
This paper
36
LDS
0.9205 ±0.0026
This paper
39
IDGL
0.9163 ±0.0124
This paper
40
BTGF
0.9162 ±0.0011
This paper
43
HAN
actual #43 vs paper #43
0.9147 ±0.0022
actual #43 vs paper #43
paper 0.9147 ±0.0022
prev best: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.9147 ±0.0022 Δ at pub 0.0068
47
HDMI
actual #47 vs paper #49 2 places worse
0.9116 ±0.0056
best reported
actual #47 vs paper #49 2 places worse
paper 0.9086 ±0.0031

Difference within reported uncertainty; not counted as underperformance.

paper 0.9086 ±0.0031 Δ at pub 0.0030
49
GIN
0.9092
54
NodeFormer
0.9060 ±0.0095
This paper
58
ProGNN
0.9050 ±0.0129
This paper
61
DMG
0.9031 ±0.0035
This paper
82
GEN
0.8788 ±0.0261
This paper
98
STABLE
0.8338 ±0.0451
This paper
109
MLP
0.7102 ±0.0221
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published