NeurIPS 2024

GC4NC: A Benchmark Framework for Graph Condensation on Node Classification with New Insights

Shengbo Gong, Juntong Ni, Noveen Sachdeva, Carl Yang, Wei Jin

Main figure for GC4NC: A Benchmark Framework for Graph Condensation on Node Classification with New Insights

Abstract

Graph condensation (GC) is an emerging technique designed to learn a significantly smaller graph that retains the essential information of the original graph. This condensed graph has shown promise in accelerating graph neural networks while preserving performance comparable to those achieved with the original, larger graphs. Additionally, this technique facilitates downstream applications like neural architecture search and deepens our understanding of redundancies in large graphs. Despite the rapid development of GC methods, particularly for node classification, a unified evaluation framework is still lacking to systematically compare different GC methods or clarify key design choices for improving their effectiveness. To bridge these gaps, we introduce GC4NC, a comprehensive framework for evaluating diverse GC methods on node classification across multiple dimensions including performance, efficiency, privacy preservation, denoising ability, NAS effectiveness, and transferability. Our systematic evaluation offers novel insights into how condensed graphs behave and the critical design choices that drive their success. These findings pave the way for future advancements in GC methods, enhancing both performance and expanding their real-world applications. The code is available at

Benchmark Results

Tested on 1 dataset 1 baseline value reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
0.9296 ±0.0015
210
MLP
0.8690 ±0.0074
540
TSpanner
0.7939 ±0.0030
This paper
571
K-Center
actual #571 vs paper #571
0.7918 ±0.0020
actual #571 vs paper #571
paper 0.7918 ±0.0020
paper 0.7918 ±0.0020 Δ at pub 0.1018
659
MSGC
0.7826
This paper
674
GDEM
0.7805 ±0.0130
This paper
690
GCond
actual #690 vs paper #721 31 places worse
0.7790
best reported
actual #690 vs paper #721 31 places worse
paper 0.7736
paper 0.7736 Δ at pub 0.0054
707
GCDMX
0.7762
This paper
764
GEOM
0.7621
This paper
773
SGDD
0.7595
This paper
782
Averaging
0.7560
This paper
783
VN
0.7560 ±0.0040
This paper
784
VNG
0.7560
This paper
824
GCondX
0.7205
This paper
851
GCSNTK
0.6837 ±0.0300
This paper
856
SFGC
0.6689
This paper
871
DosCond
0.5270
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published