Improved Dual Correlation Reduction Network

Yue Liu, Sihang Zhou, Xinwang Liu, Wenxuan Tu, Xihong Yang

Main figure for Improved Dual Correlation Reduction Network

Abstract

Deep graph clustering, which aims to reveal the underlying graph structure and divide the nodes into different clusters without human annotations, is a fundamental yet challenging task. However, we observed that the existing methods suffer from the representation collapse problem and easily tend to encode samples with different classes into the same latent embedding. Consequently, the discriminative capability of nodes is limited, resulting in sub-optimal clustering performance. To address this problem, we propose a novel deep graph clustering algorithm termed Improved Dual Correlation Reduction Network (IDCRN) through improving the discriminative capability of samples. Specifically, by approximating the cross-view feature correlation matrix to an identity matrix, we reduce the redundancy between different dimensions of features, thus improving the discriminative capability of the latent space explicitly. Meanwhile, the cross-view sample correlation matrix is forced to approximate the designed clustering-refined adjacency matrix to guide the learned latent representation to recover the affinity matrix even across views, thus enhancing the discriminative capability of features implicitly. Moreover, we avoid the collapsed representation caused by the over-smoothing issue in Graph Convolutional Networks (GCNs) through an introduced propagation regularization term, enabling IDCRN to capture the long-range information with the shallow network structure. Extensive experimental results on six benchmarks have demonstrated the effectiveness and the efficiency of IDCRN compared to the existing state-of-the-art deep graph clustering algorithms.

Proposed method: IDCRN

Benchmark Results

Tested on 3 datasets Non-standard metric on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

DBLP

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Micro-F1. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

ACM

Global leaderboard →

Default metric is Micro-F1. The paper reports 0 values on Micro-F1 , 16 values on ACC , 1 value on NMI , 1 value on ARI and 1 value on F1 .

Sorted by ACC. Highlighted rows are from other papers.

#ModelMicro-F1 ↑ defaultACC ↑NMI ↑ARI ↑F1 ↑Paper
1
AM-GCN
0.9142
—
———
2
GCN
0.9054
—
———
3
GAT
0.9040
—
———
8
IDCRN
—
0.7140 ± 0.0008
0.4677 ± 0.0021
0.5881 ± 0.0037
0.7140 ± 0.0008
Micro-F1 —
NMI 0.4677 ± 0.0021
ARI 0.5881 ± 0.0037
F1 0.7140 ± 0.0008
This paper
9
DCRN
—
0.7086 ± 0.0018
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
10
DFCN
—
0.6950 ± 0.0020
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
11
MVGRL
—
0.6866 ± 0.0036
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
13
SDCN
—
0.6596 ± 0.0031
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
14
MCGC
—
0.6476 ± 0.0007
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
15
DAEGC
—
0.6454 ± 0.0139
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
16
SDCN_Q
—
0.6167 ± 0.0105
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
17
GAE
—
0.6135 ± 0.0080
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
18
ARGA
—
0.6107 ± 0.0049
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
19
VGAE
—
0.6097 ± 0.0036
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
20
IDEC
—
0.6049 ± 0.0142
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
21
ARVGA
—
0.5931 ± 0.0138
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
22
AE
—
0.5708 ± 0.0013
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
23
DEC
—
0.5589 ± 0.0020
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper
25
K-means
—
0.3932 ± 0.0317
———
Micro-F1 —
NMI —
ARI —
F1 —
This paper

Hypergraph Benchmarks

AMAP

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Accuracy. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

#ModelF1 ↑Paper
1
GANN
0.9405 ±0.0037
2
GPRGNN
0.9308 ±0.0026
3
GAT
0.9238 ±0.0014
12
IDCRN
0.8208 ±0.0018
This paper
14
GCN
0.8115 ±0.0105
15
DCRN
0.7966 ±0.0025
This paper
16
DFCN
0.7600 ±0.0080
This paper
26
DAEGC
actual #26 vs paper #36 10 places worse
0.6987 ±0.0054
best reported
actual #26 vs paper #36 10 places worse
paper 0.6205 ±0.0048
paper 0.6205 ±0.0048 Δ today 0.0782
28
MCGC
actual #28 vs paper #38 10 places worse
0.6860
best reported
actual #28 vs paper #38 10 places worse
paper 0.5892 ±0.0005
paper 0.5892 ±0.0005 Δ today 0.0968
29
GAE
actual #29 vs paper #36 7 places worse
0.6808 ±0.0176
best reported
actual #29 vs paper #36 7 places worse
paper 0.6121 ±0.0122
paper 0.6121 ±0.0122 Δ today 0.0687
31
SDCN
0.6805 ±0.0181
This paper
33
SDCN_Q
0.6574 ±0.0134
This paper
35
ARGA
0.6483 ±0.0059
This paper
38
IDEC
0.6031 ±0.0062
This paper
39
VGAE
0.5859 ±0.0006
This paper
40
DEC
0.5816 ±0.0056
This paper
42
ARVGA
0.5441 ±0.0042
This paper
45
AE
0.5143 ±0.0035
This paper
50
MVGRL
actual #50 vs paper #50
0.4600
best reported
actual #50 vs paper #50
paper 0.4273 ±0.0102
paper 0.4273 ±0.0102 Δ today 0.0327
54
K-means
0.3192 ±0.0027
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere