EXGC: Bridging Efficiency and Explainability in Graph Condensation
Abstract
Graph representation learning on vast datasets, like web data, has made significant strides. However, the associated computational and storage overheads raise concerns. In sight of this, Graph condensation (GCond) has been introduced to distill these large real datasets into a more concise yet information-rich synthetic graph. Despite acceleration efforts, existing GCond methods mainly grapple with efficiency, especially on expansive web data graphs. Hence, in this work, we pinpoint two major inefficiencies of current paradigms: (1) the concurrent updating of a vast parameter set, and (2) pronounced parameter redundancy. To counteract these two limitations correspondingly, we first (1) employ the Mean-Field variational approximation for convergence acceleration, and then (2) propose the objective of Gradient Information Bottleneck (GDIB) to prune redundancy. By incorporating the leading explanation techniques (e.g., GNNExplainer and GSAT) to instantiate the GDIB, our EXGC, the Efficient and eXplainable Graph Condensation method is proposed, which can markedly boost efficiency and inject explainability. Our extensive evaluations across eight datasets underscore EXGC's superiority and relevance. Code is available at.
Benchmark Results
Tested on 3 datasets 6 baseline values reported too low Non-standard metric on 1 dataset
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 | |
| 523 | Random | 0.8209
±0.0008 best reported | best at pub: NAS-Bench-Graph: Benchmarking Graph Neural Architecture Search (NeurIPS 2022) |
| 529 | EXGC | 0.8202
±0.0042 | This paper |
| 613 | EXGC-X | 0.8091
±0.0039 | This paper |
| 614 | Full Graph | 0.8091
±0.0010 | This paper |
| 615 | GCond | 0.8090
±0.0320 best reported | best today: TinyGraph: Joint Feature and Node Condensation for Graph Neural Networks (2024) |
| 724 | MLP | 0.7768 | |
| 742 | Herding | 0.7680
±0.0010 best reported | best at pub: Fast Graph Condensation with Structure-based Neural Tangent Kernel (WWW 2023) best today: Simple Graph Condensation (2024) |
| 743 | K-Center | 0.7670
±0.0010 best reported | best at pub: Fast Graph Condensation with Structure-based Neural Tangent Kernel (WWW 2023) best today: Simple Graph Condensation (2024) |
| 826 | GCond-X | 0.6910
±0.0031 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 44 | GCN | 0.8033
±0.0088 | |
| 350 | MLP | 0.7289
±0.0010 | |
| 550 | Full Graph | 0.7112
±0.0006 | This paper |
| 572 | GCond | 0.7080
±0.0450 best reported | best at pub: Condensing Graphs via One-Step Gradient Matching (KDD 2022) best today: TinyGraph: Joint Feature and Node Condensation for Graph Neural Networks (2024) Difference within reported uncertainty; not counted as underperformance. |
| 593 | Random | 0.7049
±0.0008 best reported | best at pub: NAS-Bench-Graph: Benchmarking Graph Neural Architecture Search (NeurIPS 2022) |
| 648 | EXGC | 0.6916
±0.0200 | This paper |
| 650 | K-Center | 0.6910
±0.0010 best reported | best today: Simple Graph Condensation (2024) |
| 651 | Herding | 0.6900
±0.0010 best reported | best today: Simple Graph Condensation (2024) |
| 694 | EXGC-X | 0.6782
±0.0131 | This paper |
| 790 | GCond-X | 0.6413
±0.0183 | This paper |
Sorted by Accuracy. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GAP-EDP | 0.9870
±0.0003 | |
| 2 | NE-ASGCN | 0.9758
±0.0027 | |
| 3 | HSGT | 0.9730
±0.0024 | |
| 21 | GraphSAGE | 0.9653
±0.0011 | |
| 80 | Full Graph | 0.9396
±0.0003 | This paper |
| 113 | Random | 0.9110 best reported | |
| 120 | GCond | 0.9030
±0.0310 best reported | best at pub: Graph Condensation for Inductive Node Representation Learning (2023) best today: TinyGraph: Joint Feature and Node Condensation for Graph Neural Networks (2024) Difference within reported uncertainty; not counted as underperformance. |
| 121 | EXGC | 0.9024
±0.0005 | This paper |
| 127 | EXGC-X | 0.8956
±0.0045 | This paper |
| 130 | GCond-X | 0.8934
±0.0054 | prev best: Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Data (NeurIPS 2023) Improvement within reported uncertainty; not highlighted. |
| 147 | MLP | 0.8240
±0.0010 | |
| 153 | Herding | 0.7140
±0.0160 best reported | best at pub: Disentangled Condensation for Large-scale Graphs (WWW 2024) best today: Simple Graph Condensation (2024) |
| 161 | K-Center | 0.5740
±0.0180 best reported | best at pub: Disentangled Condensation for Large-scale Graphs (WWW 2024) best today: Simple Graph Condensation (2024) Difference within reported uncertainty; not counted as underperformance. |
