TMLR 2024

Extending Graph Condensation to Multi-Label Datasets: A Benchmark Study

Liangliang Zhang, Haoran Bao, Yao Ma

Main figure for Extending Graph Condensation to Multi-Label Datasets: A Benchmark Study

Abstract

As graph data grows increasingly complicate, training graph neural networks (GNNs) on large-scale datasets presents significant challenges, including computational resource constraints, data redundancy, and transmission inefficiencies. While existing graph condensation techniques have shown promise in addressing these issues, they are predominantly designed for single-label datasets, where each node is associated with a single class label. However, many real-world applications, such as social network analysis and bioinformatics, involve multi-label graph datasets, where one node can have various related labels. To deal with this problem, we extends traditional graph condensation approaches to accommodate multi-label datasets by introducing modifications to synthetic dataset initialization and condensing optimization. Through experiments on eight real-world multi-label graph datasets, we prove the effectiveness of our method. In experiment, the GCond framework, combined with K-Center initialization and binary cross-entropy loss (BCELoss), achieves best performance in general. This benchmark for multi-label graph condensation not only enhances the scalability and efficiency of GNNs for multi-label graph data, but also offering substantial benefits for diverse real-world applications.

Benchmark Results

Tested on 3 datasets Non-standard metric on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelF1 ↑Paper
1
GAMLP(JK)
0.9982 ±0.0001
2
GraphCON-GCN
0.9960
3
GCNII
0.9953 ±0.0001
21
GCN
0.9850
166
Whole Dataset
0.5126
This paper
170
K-Center (Subgraph)
0.4777
This paper
171
Random (Subgraph)
0.4705
This paper
173
MLP
0.4620
178
Herding (Subgraph)
0.4093
This paper
179
Probability
0.4004
This paper

OGB

ogbn-proteins

Global leaderboard →

Default metric is ROC-AUC. The paper reports 0 values on ROC-AUC , 8 values on F1-micro and 2 values on F1-macro .

Sorted by F1-micro. Highlighted rows are from other papers.

#ModelROC-AUC ↑ defaultF1-micro ↑F1-macro ↑Paper
1
Coreset (K-Center)
—
0.3104
—
ROC-AUC —
F1-macro —
This paper
2
Whole Dataset
—
0.3059
—
ROC-AUC —
F1-macro —
This paper
3
K-Center (Subgraph)
—
0.2995
—
ROC-AUC —
F1-macro —
This paper
4
GCond
—
0.2940
0.0747
ROC-AUC —
F1-macro 0.0747
This paper
5
Random (With A')
—
0.2888
—
ROC-AUC —
F1-macro —
This paper
6
Probability (With A')
—
0.2711
—
ROC-AUC —
F1-macro —
This paper
7
Herding (With A')
—
0.2621
—
ROC-AUC —
F1-macro —
This paper
8
GCDM
—
0.2218
0.0307
ROC-AUC —
F1-macro 0.0307
This paper

Heterogeneous Graph Benchmarks

DBLP

Global leaderboard →
Non-default metric. This paper reports F1-micro; the dataset default is Micro-F1. Values below use F1-micro only.

Sorted by F1-micro. Highlighted rows are from other papers.

#ModelF1-micro ↑Paper
1
Whole Dataset
0.8755
This paper
2
GCond (K-Center, With A')
0.7074
This paper
3
Random (Subgraph)
0.6356
This paper
4
K-Center (Subgraph)
0.6036
This paper
5
Coreset (K-Center)
0.5270
This paper
6
GCDM
0.4441
This paper
7
SGDD
0.4317
This paper
8
Herding (Subgraph)
0.4154
This paper
9
Probability
0.4135
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers)