GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck

Shuangjie Li, Jia Song, Baoming Zhang, Gaoli Ruan, Junyuan Xie, Chongjun Wang

Main figure for GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck

Abstract

Graph neural networks (GNNs) are prominent for their effectiveness in processing graph data for semi-supervised node classification tasks. Most works of GNNs assume that the observed structure accurately represents the underlying node relationships. However, the graph structure is inevitably noisy or incomplete in reality, which can degrade the quality of graph representations. Therefore, it is imperative to learn a clean graph structure that balances performance and robustness. In this paper, we propose a novel method named Global-augmented Graph Structure Learning (GaGSL), guided by the Graph Information Bottleneck (GIB) principle. The key idea behind GaGSL is to learn a compact and informative graph structure for node classification tasks. Specifically, to mitigate the bias caused by relying solely on the original structure, we first obtain augmented features and augmented structure through global feature augmentation and global structure augmentation. We then input the augmented features and augmented structure into a structure estimator with different parameters for optimization and re-definition of the graph structure, respectively. The redefined structures are combined to form the final graph structure. Finally, we employ GIB based on mutual information to guide the optimization of the graph structure to obtain the minimum sufficient graph structure. Comprehensive evaluations across a range of datasets reveal the outstanding performance and robustness of GaGSL compared with the state-of-the-art methods.

Proposed method: GaGSL

Benchmark Results

Tested on 2 datasets Non-standard metric on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

Cora

Global leaderboard →

Default metric is Accuracy. The paper reports 0 values on Accuracy , 8 values on AUC , 8 values on F1-macro and 8 values on F1-micro .

Sorted by AUC. Highlighted rows are from other papers.

#ModelAccuracy ↑ defaultAUC ↑F1-macro ↑F1-micro ↑Paper
1
GaGSL
—
0.9730 ± 0.0030
0.8230 ± 0.0110
0.8380 ± 0.0120
Accuracy —
F1-macro 0.8230 ± 0.0110
F1-micro 0.8380 ± 0.0120
This paper
2
IDGL
—
0.9700 ± 0.0030
0.8040 ± 0.0130
0.8220 ± 0.0260
Accuracy —
F1-macro 0.8040 ± 0.0130
F1-micro 0.8220 ± 0.0260
This paper
3
Pro-GNN
—
0.9690 ± 0.0090
0.7880 ± 0.0260
0.7980 ± 0.0260
Accuracy —
F1-macro 0.7880 ± 0.0260
F1-micro 0.7980 ± 0.0260
This paper
4
SGC
—
0.9610 ± 0.0010
0.7840 ± 0.0020
0.7940 ± 0.0020
Accuracy —
F1-macro 0.7840 ± 0.0020
F1-micro 0.7940 ± 0.0020
This paper
5
PRI-GSL
—
0.9580 ± 0.0030
0.7500 ± 0.0040
0.7670 ± 0.0070
Accuracy —
F1-macro 0.7500 ± 0.0040
F1-micro 0.7670 ± 0.0070
This paper
6
GEN
—
0.9400 ± 0.0190
0.8010 ± 0.0130
0.9140 ± 0.0200
Accuracy —
F1-macro 0.8010 ± 0.0130
F1-micro 0.9140 ± 0.0200
This paper
7
GCN
—
0.9370 ± 0.0070
0.7430 ± 0.0180
0.7510 ± 0.0230
Accuracy —
F1-macro 0.7430 ± 0.0180
F1-micro 0.7510 ± 0.0230
This paper
8
GAT
—
0.9250 ± 0.0070
0.7030 ± 0.0090
0.7140 ± 0.0110
Accuracy —
F1-macro 0.7030 ± 0.0090
F1-micro 0.7140 ± 0.0110
This paper

CiteSeer

Global leaderboard →

Default metric is Accuracy. The paper reports 0 values on Accuracy , 8 values on AUC , 8 values on F1-macro and 8 values on F1-micro .

Sorted by AUC. Highlighted rows are from other papers.

#ModelAccuracy ↑ defaultAUC ↑F1-macro ↑F1-micro ↑Paper
1
IDGL
—
0.9140 ± 0.0040
0.6940 ± 0.0040
0.7190 ± 0.0030
Accuracy —
F1-macro 0.6940 ± 0.0040
F1-micro 0.7190 ± 0.0030
This paper
2
GaGSL
—
0.9060 ± 0.0050
0.6880 ± 0.0090
0.7210 ± 0.0110
Accuracy —
F1-macro 0.6880 ± 0.0090
F1-micro 0.7210 ± 0.0110
This paper
3
GEN
—
0.9010 ± 0.0170
0.6940 ± 0.0140
0.7270 ± 0.0130
Accuracy —
F1-macro 0.6940 ± 0.0140
F1-micro 0.7270 ± 0.0130
This paper
4
SGC
—
0.8990 ± 0.0020
0.6640 ± 0.0050
0.7060 ± 0.0010
Accuracy —
F1-macro 0.6640 ± 0.0050
F1-micro 0.7060 ± 0.0010
This paper
5
GAT
—
0.8940 ± 0.0020
0.6330 ± 0.0120
0.6620 ± 0.0120
Accuracy —
F1-macro 0.6330 ± 0.0120
F1-micro 0.6620 ± 0.0120
This paper
6
PRI-GSL
—
0.8860 ± 0.0020
0.6450 ± 0.0040
0.6760 ± 0.0060
Accuracy —
F1-macro 0.6450 ± 0.0040
F1-micro 0.6760 ± 0.0060
This paper
7
Pro-GNN
—
0.8850 ± 0.0030
0.6310 ± 0.0070
0.6560 ± 0.0080
Accuracy —
F1-macro 0.6310 ± 0.0070
F1-micro 0.6560 ± 0.0080
This paper
8
GCN
—
0.8750 ± 0.0120
0.6320 ± 0.0040
0.6710 ± 0.0030
Accuracy —
F1-macro 0.6320 ± 0.0040
F1-micro 0.6710 ± 0.0030
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper)