Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Data
Abstract
Graph condensation, which reduces the size of a large-scale graph by synthesizing a small-scale condensed graph as its substitution, has immediate benefits for various graph learning tasks. However, existing graph condensation methods rely on the joint optimization of nodes and structures in the condensed graph, and overlook critical issues in effectiveness and generalization ability. In this paper, we advocate a new Structure-Free Graph Condensation paradigm, named SFGC, to distill a large-scale graph into a small-scale graph node set without explicit graph structures,, graph-free data. Our idea is to implicitly encode topology structure information into the node attributes in the synthesized graph-free data, whose topology is reduced to an identity matrix. Specifically, SFGC contains two collaborative components: (1) a training trajectory meta-matching scheme for effectively synthesizing small-scale graph-free data; (2) a graph neural feature score metric for dynamically evaluating the quality of the condensed data. Through training trajectory meta-matching, SFGC aligns the long-term GNN learning behaviors between the large-scale graph and the condensed small-scale graph-free data, ensuring comprehensive and compact transfer of informative knowledge to the graph-free data. Afterward, the underlying condensed graph-free data would be dynamically evaluated with the graph neural feature score, which is a closed-form metric for ensuring the excellent expressiveness of the condensed graph-free data. Extensive experiments verify the superiority of SFGC across different condensation ratios.
Benchmark Results
Tested on 1 dataset 1 baseline value reported too low Non-standard metric on 1 dataset
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
Sorted by Accuracy. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GAP-EDP | 0.9870
±0.0003 | |
| 2 | NE-ASGCN | 0.9758
±0.0027 | |
| 3 | HSGT | 0.9730
±0.0024 | |
| 21 | GraphSAGE | 0.9653
±0.0011 | |
| 113 | Random | 0.9110 best reported | |
| 120 | GCond | 0.9030
±0.0310 best reported | best today: TinyGraph: Joint Feature and Node Condensation for Graph Neural Networks (2024) Difference within reported uncertainty; not counted as underperformance. |
| 125 | SFGC | 0.8970
±0.0020 | This paper |
| 130 | GCond-X | 0.8934
±0.0054 best reported | best today: EXGC: Bridging Efficiency and Explainability in Graph Condensation (WWW 2024) Difference within reported uncertainty; not counted as underperformance. |
| 134 | DC-Graph | 0.8820
±0.0020 | This paper |
| 147 | MLP | 0.8240
±0.0010 | |
| 153 | Herding | 0.7140
±0.0160 best reported | best today: Simple Graph Condensation (2024) |
| 161 | K-Center | 0.5740
±0.0180 best reported | best today: Simple Graph Condensation (2024) |
| 167 | Coarsening | 0.4090
±0.0050 | This paper |
