SynC: Synergistic Boosting of Structure and Representation for Deep Graph Clustering

Shifei Ding, Benyu Wu, Xiao Xu, Ling Ding, Xindong Wu

Main figure for SynC: Synergistic Boosting of Structure and Representation for Deep Graph Clustering

Abstract

Employing graph neural networks (GNNs) for graph clustering has shown promising results in deep graph clustering (DGC). However, existing methods disregard the reciprocal relationship between representation learning and structure augmentation: the more homogeneous the graph, the more cohesive the node representations; the more cohesive the node representations, the more reliable the structure augmentation becomes. Moreover, the generalization ability of existing GNN-based models on the low homophily graph is relatively poor. To this end, we propose a graph clustering framework named synergistic deep graph clustering network (SynC). SynC employs a transform input graph autoencoder (TIGAE) to obtain high-quality embeddings via mitigating the representation collapse issue of GAE for guiding structure augmentation. Then, we recapture neighborhood representations on the refined graph to obtain clustering-friendly embeddings and conduct self-supervised clustering. Notably, these two stages share weights, resulting in synergistic boosting while significantly reducing the number of model parameters. Additionally, we introduce a structure fine-tuning (SF) strategy to improve the model’s generalization on the low homophily graph. Extensive experiments on benchmark datasets demonstrate the superiority of SynC. The code is released at https://github.com/Marigoldwu/SynC.

Benchmark Results

Tested on 4 datasets 2 baseline values reported too low Non-standard metric on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterophilic Graphs

#ModelAccuracy ↑Paper
1
P^2GNN
0.9672 ±0.0147
2
DoG
0.9660 ±0.0210
3
GPF-plus
0.9583 ±0.0419
34
MLP
0.9230 ±0.0070
53
GraphSAGE
0.9000 ±0.0365
446
SynC
0.6437 ±0.0080
This paper
488
DCRN
0.6126 ±0.0045
This paper
495
DFCN
0.6060 ±0.0079
This paper
508
HSAN
0.5978 ±0.0036
This paper
517
SDCN
0.5940 ±0.0171
This paper

Heterogeneous Graph Benchmarks

DBLP

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Micro-F1. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

#ModelF1 ↑Paper
1
AUG_bal
0.9454 ±0.0123
2
AUG_min
0.9375 ±0.0115
3
AUG_ran
0.9368 ±0.0108
24
SynC SSL
0.8290 ±0.0017
This paper
25
IDCRN
0.8147 ±0.0020
This paper
28
NeuCGC
0.8071 ±0.0012
This paper
29
R^2FGC
0.8054 ±0.0019
This paper
30
AGC-DRR
0.7990 ±0.0045
This paper
31
DCRN
0.7928 ±0.0026
This paper
33
NS4GC
0.7877 ±0.0040
This paper
34
SynC KMeans
0.7719 ±0.0054
This paper
36
DFCN
actual #36 vs paper #36
0.7570 ±0.0080
actual #36 vs paper #36
paper 0.7570 ±0.0080
prev best: Deep Temporal Graph Clustering (ICLR 2023)
paper 0.7570 ±0.0080 Δ at pub 0.3973
39
SAGE
0.7320
40
HSAN
0.7113 ±0.0123
This paper
42
SDCN
actual #42 vs paper #42
0.6771 ±0.0151
actual #42 vs paper #42
paper 0.6771 ±0.0151
paper 0.6771 ±0.0151 Δ at pub 0.0391
43
SCGC
0.6706 ±0.0173
This paper
46
CCGC
0.6400 ±0.0429
This paper
47
Vanilla GAE
0.6141 ±0.0223
This paper

ACM

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Micro-F1. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

#ModelF1 ↑Paper
1
SPGRL
0.9398
2
CDC
0.9360
3
SynC SSL
0.9274 ±0.0004
This paper
4
IDCRN
actual #4 vs paper #4
0.9260 ±0.0008
actual #4 vs paper #4
paper 0.9260 ±0.0008
paper 0.9260 ±0.0008 Δ at pub 0.2120
5
AGC-DRR
0.9255 ±0.0009
This paper
6
NeuCGC
0.9247 ±0.0026
This paper
7
R^2FGC
0.9245 ±0.0018
This paper
8
DCRN
0.9194 ±0.0020
This paper
12
SynC KMeans
0.9149 ±0.0012
This paper
14
DFCN
0.9080 ±0.0020
This paper
17
GCN
0.9049
19
SDCN
0.9042 ±0.0019
This paper
25
SCGC
0.8974 ±0.0045
This paper
26
HomoCAGC
0.8917 ±0.0093
This paper
29
NS4GC
0.8881 ±0.0073
This paper
31
CCGC
0.8871 ±0.0091
This paper
36
Vanilla GAE
0.8465 ±0.0133
This paper
37
HSAN
0.8243 ±0.0251
This paper

Hypergraph Benchmarks

#ModelF1 ↑Paper
1
SCAGC
0.7277 ±0.0016
2
SCGC
actual #2 vs paper #9 7 places worse
0.7222 ±0.0097
best reported
actual #2 vs paper #9 7 places worse
paper 0.5552 ±0.0087
paper 0.5552 ±0.0087 Δ at pub 0.1670
3
AGE
0.7174 ±0.0093
6
DFCN
actual #6 vs paper #34 28 places worse
0.6718 ±0.0013
best reported
actual #6 vs paper #34 28 places worse
paper 0.2579 ±0.0029
paper 0.2579 ±0.0029 Δ at pub 0.4139
8
SynC KMeans
0.5891 ±0.0102
This paper
9
SynC SSL
0.5734 ±0.0023
This paper
10
NeuCGC
0.5535 ±0.0126
This paper
11
HomoCAGC
0.5531 ±0.0087
This paper
12
CCGC
0.5524 ±0.0169
This paper
13
Vanilla GAE
0.5439 ±0.0089
This paper
14
HSAN
0.5420 ±0.0184
This paper
20
AGC-DRR
actual #20 vs paper #20
0.5197 ±0.0210
actual #20 vs paper #20
paper 0.5197 ±0.0210
paper 0.5197 ±0.0210 Δ at pub 0.1679
21
NS4GC
0.5176 ±0.0052
This paper
22
SDCN
actual #22 vs paper #29 7 places worse
0.5066 ±0.0149
best reported
actual #22 vs paper #29 7 places worse
paper 0.4559 ±0.0354

Difference within reported uncertainty; not counted as underperformance.

paper 0.4559 ±0.0354 Δ at pub 0.0507
30
DCRN
0.4481 ±0.0087
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published