WWW 2023

SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization

Dongcheng Zou, Hao Peng, Xiang Huang, Renyu Yang, Jianxin Li, Jia Wu, Chunyang Liu, Philip S. Yu

Main figure for SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization

Abstract

Graph Neural Networks (GNNs) are de facto solutions to structural data learning. However, it is susceptible to low-quality and unreliable structure, which has been a norm rather than an exception in real-world graphs. Existing graph structure learning (GSL) frameworks still lack robustness and interpretability. This paper proposes a general GSL framework, SE-GSL, through structural entropy and the graph hierarchy abstracted in the encoding tree. Particularly, we exploit the one-dimensional structural entropy to maximize embedded information content when auxiliary neighbourhood attributes is fused to enhance the original graph. A new scheme of constructing optimal encoding trees is proposed to minimize the uncertainty and noises in the graph whilst assuring proper community partition in hierarchical abstraction. We present a novel sample-based mechanism for restoring the graph structure via node structural entropy distribution. It increases the connectivity among nodes with larger uncertainty in lower-level communities. \ SE-GSL\ is compatible with various GNN models and enhances the robustness towards noisy and heterophily structures. Extensive experiments show significant improvements in the effectiveness and robustness of structure learning and node representation learning.

Proposed method: SE-GSL

Benchmark Results

Tested on 3 datasets 16 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterophilic Graphs

#ModelAccuracy ↑Paper
1
P^2GNN
0.9672 ±0.0147
2
DoG
0.9660 ±0.0210
3
GPF-plus
0.9583 ±0.0419
34
MLP
0.9230 ±0.0070
53
GraphSAGE
0.9000 ±0.0365
70
GCNII
actual #70 vs paper #564 494 places worse
0.8918 ±0.0443
best reported
actual #70 vs paper #564 494 places worse
paper 0.5536 ±0.0645
paper 0.5536 ±0.0645 Δ at pub 0.2510 Δ today 0.3382
193
SE-GSL
0.8249 ±0.0480
This paper
204
H_2GCN-2
0.8216 ±0.0528
This paper
211
GAT
actual #211 vs paper #537 326 places worse
0.8162 ±0.0645
best reported
actual #211 vs paper #537 326 places worse
paper 0.5810 ±0.0414
paper 0.5810 ±0.0414 Δ at pub 0.2170 Δ today 0.2352
217
GRAND
actual #217 vs paper #555 338 places worse
0.8140 ±0.0350
best reported
actual #217 vs paper #555 338 places worse
paper 0.5656 ±0.0153
paper 0.5656 ±0.0153 Δ at pub 0.1912 Δ today 0.2484
257
GCN
actual #257 vs paper #549 292 places worse
0.7933 ±0.0447
best reported
actual #257 vs paper #549 292 places worse
paper 0.5730 ±0.0286
best today: Graph Wave Networks (WWW 2025)
paper 0.5730 ±0.0286 Δ at pub 0.2110 Δ today 0.2203
273
GEN
actual #273 vs paper #348 75 places worse
0.7830 ±0.0800
best reported
actual #273 vs paper #348 75 places worse
paper 0.7338 ±0.0665

Difference within reported uncertainty; not counted as underperformance.

paper 0.7338 ±0.0665 Δ at pub 0.0492
276
MixHop
actual #276 vs paper #459 183 places worse
0.7784 ±0.0773
best reported
actual #276 vs paper #459 183 places worse
paper 0.6316 ±0.0628
best at pub: Graph Pointer Neural Networks (AAAI 2021)
paper 0.6316 ±0.0628 Δ at pub 0.1468 Δ today 0.1468
514
DropEdge
actual #514 vs paper #523 9 places worse
0.5946 ±0.0811
best reported
actual #514 vs paper #523 9 places worse
paper 0.5920 ±0.0543

Difference within reported uncertainty; not counted as underperformance.

paper 0.5920 ±0.0543 Δ today 0.0026
557
GDC
0.5642 ±0.0399
This paper
#ModelAccuracy ↑Paper
1
P^2GNN
0.9541 ±0.0272
2
ACM-GCN
0.9480 ±0.0380
3
RF-GCN
0.9429
24
MLP
0.9136 ±0.0070
35
GCNII
actual #35 vs paper #391 356 places worse
0.8918 ±0.0396
best reported
actual #35 vs paper #391 356 places worse
paper 0.5876 ±0.0711
paper 0.5876 ±0.0711 Δ at pub 0.2550 Δ today 0.3042
138
SAGE
0.8269
142
GRAND
actual #142 vs paper #416 274 places worse
0.8246 ±0.0709
best reported
actual #142 vs paper #416 274 places worse
paper 0.5721 ±0.0248
paper 0.5721 ±0.0248 Δ at pub 0.2495 Δ today 0.2525
158
GAT
actual #158 vs paper #417 259 places worse
0.8190 ±0.0540
best reported
actual #158 vs paper #417 259 places worse
paper 0.5709 ±0.0632
paper 0.5709 ±0.0632 Δ at pub 0.2481
168
GEN
actual #168 vs paper #324 156 places worse
0.8100 ±0.0390
best reported
actual #168 vs paper #324 156 places worse
paper 0.6557 ±0.0674
paper 0.6557 ±0.0674 Δ at pub 0.1543
170
GCN
actual #170 vs paper #496 326 places worse
0.8082 ±0.0360
best reported
actual #170 vs paper #496 326 places worse
paper 0.4919 ±0.0180
paper 0.4919 ±0.0180 Δ at pub 0.3001 Δ today 0.3163
183
MixHop
actual #183 vs paper #339 156 places worse
0.7950 ±0.0630
best reported
actual #183 vs paper #339 156 places worse
paper 0.6447 ±0.0478
paper 0.6447 ±0.0478 Δ at pub 0.1503
230
SE-GSL
0.7521 ±0.0554
This paper
374
DropEdge
actual #374 vs paper #388 14 places worse
0.6054 ±0.0530
best reported
actual #374 vs paper #388 14 places worse
paper 0.5894 ±0.0595

Difference within reported uncertainty; not counted as underperformance.

paper 0.5894 ±0.0595 Δ today 0.0160
381
GDC
0.5946 ±0.0435
This paper
#ModelAccuracy ↑Paper
1
DiGGR
0.4535 ±0.0353
2
TRIGON
0.4402 ±0.0028
3
DoG
0.4320 ±0.0120
38
GCNII
actual #38 vs paper #335 297 places worse
0.4082 ±0.0179
best reported
actual #38 vs paper #335 297 places worse
paper 0.3066 ±0.0066
paper 0.3066 ±0.0066 Δ at pub 0.0678 Δ today 0.1016
42
MLP
0.4026 ±0.0108
68
GraphSAGE
0.3899 ±0.0085
119
GEN
actual #119 vs paper #152 33 places worse
0.3730 ±0.0140
best reported
actual #119 vs paper #152 33 places worse
paper 0.3669 ±0.0102

Difference within reported uncertainty; not counted as underperformance.

paper 0.3669 ±0.0102 Δ at pub 0.0061
135
GCN
actual #135 vs paper #404 269 places worse
0.3690
best reported
actual #135 vs paper #404 269 places worse
paper 0.2765 ±0.0055
paper 0.2765 ±0.0055 Δ at pub 0.0925
144
DropEdge
actual #144 vs paper #348 204 places worse
0.3680 ±0.0290
best reported
actual #144 vs paper #348 204 places worse
paper 0.3010 ±0.0071
162
MixHop
actual #162 vs paper #275 113 places worse
0.3648 ±0.0120
best reported
actual #162 vs paper #275 113 places worse
paper 0.3372 ±0.0076
best at pub: Deformable Graph Transformer (2022)
paper 0.3372 ±0.0076 Δ at pub 0.0207 Δ today 0.0276
171
SE-GSL
0.3634 ±0.0207
This paper
182
GAT
actual #182 vs paper #400 218 places worse
0.3605 ±0.0035
best reported
actual #182 vs paper #400 218 places worse
paper 0.2777 ±0.0059
paper 0.2777 ±0.0059 Δ at pub 0.0828
203
GRAND
actual #203 vs paper #357 154 places worse
0.3562 ±0.0101
best reported
actual #203 vs paper #357 154 places worse
paper 0.2980 ±0.0060
paper 0.2980 ±0.0060 Δ at pub 0.0582 Δ today 0.0582
380
GDC
0.2874 ±0.0076
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere