SynC: Synergistic Boosting of Structure and Representation for Deep Graph Clustering
Abstract
Employing graph neural networks (GNNs) for graph clustering has shown promising results in deep graph clustering (DGC). However, existing methods disregard the reciprocal relationship between representation learning and structure augmentation: the more homogeneous the graph, the more cohesive the node representations; the more cohesive the node representations, the more reliable the structure augmentation becomes. Moreover, the generalization ability of existing GNN-based models on the low homophily graph is relatively poor. To this end, we propose a graph clustering framework named synergistic deep graph clustering network (SynC). SynC employs a transform input graph autoencoder (TIGAE) to obtain high-quality embeddings via mitigating the representation collapse issue of GAE for guiding structure augmentation. Then, we recapture neighborhood representations on the refined graph to obtain clustering-friendly embeddings and conduct self-supervised clustering. Notably, these two stages share weights, resulting in synergistic boosting while significantly reducing the number of model parameters. Additionally, we introduce a structure fine-tuning (SF) strategy to improve the model’s generalization on the low homophily graph. Extensive experiments on benchmark datasets demonstrate the superiority of SynC. The code is released at https://github.com/Marigoldwu/SynC.
Benchmark Results
Tested on 4 datasets 2 baseline values reported too low Non-standard metric on 2 datasets
Tables show presented results in global context (best 3 papers + GCN + MLP).
Heterophilic Graphs
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | P^2GNN | 0.9672
±0.0147 | |
| 2 | DoG | 0.9660
±0.0210 | |
| 3 | GPF-plus | 0.9583
±0.0419 | |
| 34 | MLP | 0.9230
±0.0070 | |
| 53 | GraphSAGE | 0.9000
±0.0365 | |
| 446 | SynC | 0.6437
±0.0080 | This paper |
| 488 | DCRN | 0.6126
±0.0045 | This paper |
| 495 | DFCN | 0.6060
±0.0079 | This paper |
| 508 | HSAN | 0.5978
±0.0036 | This paper |
| 517 | SDCN | 0.5940
±0.0171 | This paper |
Heterogeneous Graph Benchmarks
DBLP
Global leaderboard →Sorted by F1. Highlighted rows are from other papers.
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | AUG_bal | 0.9454
±0.0123 | |
| 2 | AUG_min | 0.9375
±0.0115 | |
| 3 | AUG_ran | 0.9368
±0.0108 | |
| 24 | SynC SSL | 0.8290
±0.0017 | This paper |
| 25 | IDCRN | 0.8147
±0.0020 | This paper |
| 28 | NeuCGC | 0.8071
±0.0012 | This paper |
| 29 | R^2FGC | 0.8054
±0.0019 | This paper |
| 30 | AGC-DRR | 0.7990
±0.0045 | This paper |
| 31 | DCRN | 0.7928
±0.0026 | This paper |
| 33 | NS4GC | 0.7877
±0.0040 | This paper |
| 34 | SynC KMeans | 0.7719
±0.0054 | This paper |
| 36 | DFCN | 0.7570
±0.0080 | prev best: Deep Temporal Graph Clustering (ICLR 2023) |
| 39 | SAGE | 0.7320 | |
| 40 | HSAN | 0.7113
±0.0123 | This paper |
| 42 | SDCN | 0.6771
±0.0151 | prev best: Unsupervised Network Embedding Beyond Homophily (TMLR 2022) |
| 43 | SCGC | 0.6706
±0.0173 | This paper |
| 46 | CCGC | 0.6400
±0.0429 | This paper |
| 47 | Vanilla GAE | 0.6141
±0.0223 | This paper |
ACM
Global leaderboard →Sorted by F1. Highlighted rows are from other papers.
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | SPGRL | 0.9398 | |
| 2 | CDC | 0.9360 | |
| 3 | SynC SSL | 0.9274
±0.0004 | This paper |
| 4 | IDCRN | 0.9260
±0.0008 | prev best: Improved Dual Correlation Reduction Network (2022) |
| 5 | AGC-DRR | 0.9255
±0.0009 | This paper |
| 6 | NeuCGC | 0.9247
±0.0026 | This paper |
| 7 | R^2FGC | 0.9245
±0.0018 | This paper |
| 8 | DCRN | 0.9194
±0.0020 | This paper |
| 12 | SynC KMeans | 0.9149
±0.0012 | This paper |
| 14 | DFCN | 0.9080
±0.0020 | This paper |
| 17 | GCN | 0.9049 | |
| 19 | SDCN | 0.9042
±0.0019 | This paper |
| 25 | SCGC | 0.8974
±0.0045 | This paper |
| 26 | HomoCAGC | 0.8917
±0.0093 | This paper |
| 29 | NS4GC | 0.8881
±0.0073 | This paper |
| 31 | CCGC | 0.8871
±0.0091 | This paper |
| 36 | Vanilla GAE | 0.8465
±0.0133 | This paper |
| 37 | HSAN | 0.8243
±0.0251 | This paper |
Hypergraph Benchmarks
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | SCAGC | 0.7277
±0.0016 | |
| 2 | SCGC | 0.7222
±0.0097 best reported | best at pub: Simple Contrastive Graph Clustering (2022) |
| 3 | AGE | 0.7174
±0.0093 | |
| 6 | DFCN | 0.6718
±0.0013 best reported | best at pub: Simple Contrastive Graph Clustering (2022) |
| 8 | SynC KMeans | 0.5891
±0.0102 | This paper |
| 9 | SynC SSL | 0.5734
±0.0023 | This paper |
| 10 | NeuCGC | 0.5535
±0.0126 | This paper |
| 11 | HomoCAGC | 0.5531
±0.0087 | This paper |
| 12 | CCGC | 0.5524
±0.0169 | This paper |
| 13 | Vanilla GAE | 0.5439
±0.0089 | This paper |
| 14 | HSAN | 0.5420
±0.0184 | This paper |
| 20 | AGC-DRR | 0.5197
±0.0210 | prev best: GraphLearner: Graph Node Clustering with Fully Learnable Augmentation (2022) |
| 21 | NS4GC | 0.5176
±0.0052 | This paper |
| 22 | SDCN | 0.5066
±0.0149 best reported | best at pub: Simple Contrastive Graph Clustering (2022) Difference within reported uncertainty; not counted as underperformance. |
| 30 | DCRN | 0.4481
±0.0087 | This paper |
