GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck
Abstract
Graph neural networks (GNNs) are prominent for their effectiveness in processing graph data for semi-supervised node classification tasks. Most works of GNNs assume that the observed structure accurately represents the underlying node relationships. However, the graph structure is inevitably noisy or incomplete in reality, which can degrade the quality of graph representations. Therefore, it is imperative to learn a clean graph structure that balances performance and robustness. In this paper, we propose a novel method named Global-augmented Graph Structure Learning (GaGSL), guided by the Graph Information Bottleneck (GIB) principle. The key idea behind GaGSL is to learn a compact and informative graph structure for node classification tasks. Specifically, to mitigate the bias caused by relying solely on the original structure, we first obtain augmented features and augmented structure through global feature augmentation and global structure augmentation. We then input the augmented features and augmented structure into a structure estimator with different parameters for optimization and re-definition of the graph structure, respectively. The redefined structures are combined to form the final graph structure. Finally, we employ GIB based on mutual information to guide the optimization of the graph structure to obtain the minimum sufficient graph structure. Comprehensive evaluations across a range of datasets reveal the outstanding performance and robustness of GaGSL compared with the state-of-the-art methods.
Benchmark Results
Tested on 2 datasets Non-standard metric on 2 datasets
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
Cora
Global leaderboard →Default metric is Accuracy. The paper reports 0 values on Accuracy , 8 values on AUC , 8 values on F1-macro and 8 values on F1-micro .
Sorted by AUC. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ default | AUC ↑ | F1-macro ↑ | F1-micro ↑ | Paper |
|---|---|---|---|---|---|---|
| 1 | GaGSL | — | 0.9730
±
0.0030 | 0.8230
±
0.0110 | 0.8380
±
0.0120 | Accuracy
— F1-macro
0.8230
±
0.0110 F1-micro
0.8380
±
0.0120 |
| 2 | IDGL | — | 0.9700
±
0.0030 | 0.8040
±
0.0130 | 0.8220
±
0.0260 | Accuracy
— F1-macro
0.8040
±
0.0130 F1-micro
0.8220
±
0.0260 |
| 3 | Pro-GNN | — | 0.9690
±
0.0090 | 0.7880
±
0.0260 | 0.7980
±
0.0260 | Accuracy
— F1-macro
0.7880
±
0.0260 F1-micro
0.7980
±
0.0260 |
| 4 | SGC | — | 0.9610
±
0.0010 | 0.7840
±
0.0020 | 0.7940
±
0.0020 | Accuracy
— F1-macro
0.7840
±
0.0020 F1-micro
0.7940
±
0.0020 |
| 5 | PRI-GSL | — | 0.9580
±
0.0030 | 0.7500
±
0.0040 | 0.7670
±
0.0070 | Accuracy
— F1-macro
0.7500
±
0.0040 F1-micro
0.7670
±
0.0070 |
| 6 | GEN | — | 0.9400
±
0.0190 | 0.8010
±
0.0130 | 0.9140
±
0.0200 | Accuracy
— F1-macro
0.8010
±
0.0130 F1-micro
0.9140
±
0.0200 |
| 7 | GCN | — | 0.9370
±
0.0070 | 0.7430
±
0.0180 | 0.7510
±
0.0230 | Accuracy
— F1-macro
0.7430
±
0.0180 F1-micro
0.7510
±
0.0230 |
| 8 | GAT | — | 0.9250
±
0.0070 | 0.7030
±
0.0090 | 0.7140
±
0.0110 | Accuracy
— F1-macro
0.7030
±
0.0090 F1-micro
0.7140
±
0.0110 |
CiteSeer
Global leaderboard →Default metric is Accuracy. The paper reports 0 values on Accuracy , 8 values on AUC , 8 values on F1-macro and 8 values on F1-micro .
Sorted by AUC. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ default | AUC ↑ | F1-macro ↑ | F1-micro ↑ | Paper |
|---|---|---|---|---|---|---|
| 1 | IDGL | — | 0.9140
±
0.0040 | 0.6940
±
0.0040 | 0.7190
±
0.0030 | Accuracy
— F1-macro
0.6940
±
0.0040 F1-micro
0.7190
±
0.0030 |
| 2 | GaGSL | — | 0.9060
±
0.0050 | 0.6880
±
0.0090 | 0.7210
±
0.0110 | Accuracy
— F1-macro
0.6880
±
0.0090 F1-micro
0.7210
±
0.0110 |
| 3 | GEN | — | 0.9010
±
0.0170 | 0.6940
±
0.0140 | 0.7270
±
0.0130 | Accuracy
— F1-macro
0.6940
±
0.0140 F1-micro
0.7270
±
0.0130 |
| 4 | SGC | — | 0.8990
±
0.0020 | 0.6640
±
0.0050 | 0.7060
±
0.0010 | Accuracy
— F1-macro
0.6640
±
0.0050 F1-micro
0.7060
±
0.0010 |
| 5 | GAT | — | 0.8940
±
0.0020 | 0.6330
±
0.0120 | 0.6620
±
0.0120 | Accuracy
— F1-macro
0.6330
±
0.0120 F1-micro
0.6620
±
0.0120 |
| 6 | PRI-GSL | — | 0.8860
±
0.0020 | 0.6450
±
0.0040 | 0.6760
±
0.0060 | Accuracy
— F1-macro
0.6450
±
0.0040 F1-micro
0.6760
±
0.0060 |
| 7 | Pro-GNN | — | 0.8850
±
0.0030 | 0.6310
±
0.0070 | 0.6560
±
0.0080 | Accuracy
— F1-macro
0.6310
±
0.0070 F1-micro
0.6560
±
0.0080 |
| 8 | GCN | — | 0.8750
±
0.0120 | 0.6320
±
0.0040 | 0.6710
±
0.0030 | Accuracy
— F1-macro
0.6320
±
0.0040 F1-micro
0.6710
±
0.0030 |
