WWW 2024

EXGC: Bridging Efficiency and Explainability in Graph Condensation

Junfeng Fang, Xinglin Li, Yongduo Sui, Yuan Gao, Guibin Zhang, Kun Wang, Xiang Wang, Xiangnan He

Main figure for EXGC: Bridging Efficiency and Explainability in Graph Condensation

Abstract

Graph representation learning on vast datasets, like web data, has made significant strides. However, the associated computational and storage overheads raise concerns. In sight of this, Graph condensation (GCond) has been introduced to distill these large real datasets into a more concise yet information-rich synthetic graph. Despite acceleration efforts, existing GCond methods mainly grapple with efficiency, especially on expansive web data graphs. Hence, in this work, we pinpoint two major inefficiencies of current paradigms: (1) the concurrent updating of a vast parameter set, and (2) pronounced parameter redundancy. To counteract these two limitations correspondingly, we first (1) employ the Mean-Field variational approximation for convergence acceleration, and then (2) propose the objective of Gradient Information Bottleneck (GDIB) to prune redundancy. By incorporating the leading explanation techniques (e.g., GNNExplainer and GSAT) to instantiate the GDIB, our EXGC, the Efficient and eXplainable Graph Condensation method is proposed, which can markedly boost efficiency and inject explainability. Our extensive evaluations across eight datasets underscore EXGC's superiority and relevance. Code is available at.

Benchmark Results

Tested on 3 datasets 6 baseline values reported too low Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
0.9004
523
Random
actual #523 vs paper #909 386 places worse
0.8209 ±0.0008
best reported
actual #523 vs paper #909 386 places worse
paper 0.3704 ±0.0741
paper 0.3704 ±0.0741 Δ at pub 0.4505
529
EXGC
0.8202 ±0.0042
This paper
613
EXGC-X
0.8091 ±0.0039
This paper
614
Full Graph
0.8091 ±0.0010
This paper
615
GCond
actual #615 vs paper #797 182 places worse
0.8090 ±0.0320
best reported
actual #615 vs paper #797 182 places worse
paper 0.7276 ±0.0045
paper 0.7276 ±0.0045 Δ today 0.0814
724
MLP
0.7768
742
Herding
actual #742 vs paper #907 165 places worse
0.7680 ±0.0010
best reported
actual #742 vs paper #907 165 places worse
paper 0.4347 ±0.0055
best today: Simple Graph Condensation (2024)
paper 0.4347 ±0.0055 Δ at pub 0.3333 Δ today 0.3333
743
K-Center
actual #743 vs paper #904 161 places worse
0.7670 ±0.0010
best reported
actual #743 vs paper #904 161 places worse
paper 0.4633 ±0.0324
best today: Simple Graph Condensation (2024)
paper 0.4633 ±0.0324 Δ at pub 0.3037 Δ today 0.3037
826
GCond-X
0.6910 ±0.0031
This paper
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
44
GCN
0.8033 ±0.0088
350
MLP
0.7289 ±0.0010
550
Full Graph
0.7112 ±0.0006
This paper
572
GCond
actual #572 vs paper #795 223 places worse
0.7080 ±0.0450
best reported
actual #572 vs paper #795 223 places worse
paper 0.6398 ±0.0431

Difference within reported uncertainty; not counted as underperformance.

paper 0.6398 ±0.0431 Δ at pub 0.0662 Δ today 0.0682
593
Random
actual #593 vs paper #889 296 places worse
0.7049 ±0.0008
best reported
actual #593 vs paper #889 296 places worse
paper 0.3387 ±0.0082
paper 0.3387 ±0.0082 Δ at pub 0.3662
648
EXGC
0.6916 ±0.0200
This paper
650
K-Center
actual #650 vs paper #889 239 places worse
0.6910 ±0.0010
best reported
actual #650 vs paper #889 239 places worse
paper 0.3403 ±0.0252
best today: Simple Graph Condensation (2024)
paper 0.3403 ±0.0252 Δ today 0.3507
651
Herding
actual #651 vs paper #891 240 places worse
0.6900 ±0.0010
best reported
actual #651 vs paper #891 240 places worse
paper 0.3131 ±0.0120
best today: Simple Graph Condensation (2024)
paper 0.3131 ±0.0120 Δ today 0.3769
694
EXGC-X
0.6782 ±0.0131
This paper
790
GCond-X
0.6413 ±0.0183
This paper

Reddit

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is F1. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
GAP-EDP
0.9870 ±0.0003
2
NE-ASGCN
0.9758 ±0.0027
3
HSGT
0.9730 ±0.0024
21
GraphSAGE
0.9653 ±0.0011
80
Full Graph
0.9396 ±0.0003
This paper
113
Random
actual #113 vs paper #160 47 places worse
0.9110
best reported
actual #113 vs paper #160 47 places worse
paper 0.5914 ±0.0226
120
GCond
actual #120 vs paper #126 6 places worse
0.9030 ±0.0310
best reported
actual #120 vs paper #126 6 places worse
paper 0.8956 ±0.0074

Difference within reported uncertainty; not counted as underperformance.

paper 0.8956 ±0.0074 Δ at pub 0.0007 Δ today 0.0074
121
EXGC
0.9024 ±0.0005
This paper
127
EXGC-X
0.8956 ±0.0045
This paper
130
GCond-X
actual #130 vs paper #130
0.8934 ±0.0054
actual #130 vs paper #130
paper 0.8934 ±0.0054

Improvement within reported uncertainty; not highlighted.

paper 0.8934 ±0.0054 Δ at pub 0.0094
147
MLP
0.8240 ±0.0010
153
Herding
actual #153 vs paper #154 1 place worse
0.7140 ±0.0160
best reported
actual #153 vs paper #154 1 place worse
paper 0.6575 ±0.0128
best today: Simple Graph Condensation (2024)
paper 0.6575 ±0.0128 Δ at pub 0.0565 Δ today 0.0565
161
K-Center
actual #161 vs paper #164 3 places worse
0.5740 ±0.0180
best reported
actual #161 vs paper #164 3 places worse
paper 0.5305 ±0.0273
best today: Simple Graph Condensation (2024)

Difference within reported uncertainty; not counted as underperformance.

paper 0.5305 ±0.0273 Δ at pub 0.0435 Δ today 0.0435
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere