Improved Dual Correlation Reduction Network
Abstract
Deep graph clustering, which aims to reveal the underlying graph structure and divide the nodes into different clusters without human annotations, is a fundamental yet challenging task. However, we observed that the existing methods suffer from the representation collapse problem and easily tend to encode samples with different classes into the same latent embedding. Consequently, the discriminative capability of nodes is limited, resulting in sub-optimal clustering performance. To address this problem, we propose a novel deep graph clustering algorithm termed Improved Dual Correlation Reduction Network (IDCRN) through improving the discriminative capability of samples. Specifically, by approximating the cross-view feature correlation matrix to an identity matrix, we reduce the redundancy between different dimensions of features, thus improving the discriminative capability of the latent space explicitly. Meanwhile, the cross-view sample correlation matrix is forced to approximate the designed clustering-refined adjacency matrix to guide the learned latent representation to recover the affinity matrix even across views, thus enhancing the discriminative capability of features implicitly. Moreover, we avoid the collapsed representation caused by the over-smoothing issue in Graph Convolutional Networks (GCNs) through an introduced propagation regularization term, enabling IDCRN to capture the long-range information with the shallow network structure. Extensive experimental results on six benchmarks have demonstrated the effectiveness and the efficiency of IDCRN compared to the existing state-of-the-art deep graph clustering algorithms.
Benchmark Results
Tested on 3 datasets Non-standard metric on 3 datasets
Tables show presented results in global context (best 3 papers + GCN + MLP).
Heterogeneous Graph Benchmarks
DBLP
Global leaderboard →Sorted by F1. Highlighted rows are from other papers.
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | AUG_bal | 0.9454
±0.0123 | |
| 2 | AUG_min | 0.9375
±0.0115 | |
| 3 | AUG_ran | 0.9368
±0.0108 | |
| 25 | IDCRN | 0.8147
±0.0020 | This paper |
| 39 | SAGE | 0.7320 |
ACM
Global leaderboard →Default metric is Micro-F1. The paper reports 0 values on Micro-F1 , 16 values on ACC , 1 value on NMI , 1 value on ARI and 1 value on F1 .
Sorted by ACC. Highlighted rows are from other papers.
| # | Model | Micro-F1 ↑ default | ACC ↑ | NMI ↑ | ARI ↑ | F1 ↑ | Paper |
|---|---|---|---|---|---|---|---|
| 1 | AM-GCN | 0.9142 | —
| — | — | — | Micro-F1
0.9142 NMI
— ARI
— F1
— |
| 2 | GCN | 0.9054 | —
| — | — | — | Micro-F1
0.9054 NMI
— ARI
— F1
— |
| 3 | GAT | 0.9040 | —
| — | — | — | Micro-F1
0.9040 NMI
— ARI
— F1
— |
| 8 | IDCRN | — | 0.7140
±
0.0008 | 0.4677
±
0.0021 | 0.5881
±
0.0037 | 0.7140
±
0.0008 | Micro-F1
— NMI
0.4677
±
0.0021 ARI
0.5881
±
0.0037 F1
0.7140
±
0.0008 |
| 9 | DCRN | — | 0.7086
±
0.0018 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 10 | DFCN | — | 0.6950
±
0.0020 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 11 | MVGRL | — | 0.6866
±
0.0036 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 13 | SDCN | — | 0.6596
±
0.0031 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 14 | MCGC | — | 0.6476
±
0.0007 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 15 | DAEGC | — | 0.6454
±
0.0139 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 16 | SDCN_Q | — | 0.6167
±
0.0105 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 17 | GAE | — | 0.6135
±
0.0080 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 18 | ARGA | — | 0.6107
±
0.0049 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 19 | VGAE | — | 0.6097
±
0.0036 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 20 | IDEC | — | 0.6049
±
0.0142 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 21 | ARVGA | — | 0.5931
±
0.0138 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 22 | AE | — | 0.5708
±
0.0013 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 23 | DEC | — | 0.5589
±
0.0020 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
| 25 | K-means | — | 0.3932
±
0.0317 | — | — | — | Micro-F1
— NMI
— ARI
— F1
— |
Hypergraph Benchmarks
AMAP
Global leaderboard →Sorted by F1. Highlighted rows are from other papers.
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | GANN | 0.9405
±0.0037 | |
| 2 | GPRGNN | 0.9308
±0.0026 | |
| 3 | GAT | 0.9238
±0.0014 | |
| 12 | IDCRN | 0.8208
±0.0018 | This paper |
| 14 | GCN | 0.8115
±0.0105 | |
| 15 | DCRN | 0.7966
±0.0025 | This paper |
| 16 | DFCN | 0.7600
±0.0080 | This paper |
| 26 | DAEGC | 0.6987
±0.0054 best reported | best today: Hard Sample Aware Network for Contrastive Deep Graph Clustering [5] (AAAI 2022) |
| 28 | MCGC | 0.6860 best reported | best today: CDC: A Simple Framework for Complex Data Clustering (2024) |
| 29 | GAE | 0.6808
±0.0176 best reported | best today: Simple Contrastive Graph Clustering (2022) |
| 31 | SDCN | 0.6805
±0.0181 | This paper |
| 33 | SDCN_Q | 0.6574
±0.0134 | This paper |
| 35 | ARGA | 0.6483
±0.0059 | This paper |
| 38 | IDEC | 0.6031
±0.0062 | This paper |
| 39 | VGAE | 0.5859
±0.0006 | This paper |
| 40 | DEC | 0.5816
±0.0056 | This paper |
| 42 | ARVGA | 0.5441
±0.0042 | This paper |
| 45 | AE | 0.5143
±0.0035 | This paper |
| 50 | MVGRL | 0.4600 best reported | best today: CDC: A Simple Framework for Complex Data Clustering (2024) |
| 54 | K-means | 0.3192
±0.0027 | This paper |
