Deep Graph-Level Clustering Using Pseudo-Label-Guided Mutual Information Maximization Network

Jinyu Cai, Yi Han, Wenzhong Guo, Jicong Fan

Main figure for Deep Graph-Level Clustering Using Pseudo-Label-Guided Mutual Information Maximization Network

Abstract

In this work, we study the problem of partitioning a set of graphs into different groups such that the graphs in the same group are similar while the graphs in different groups are dissimilar. This problem was rarely studied previously, although there have been a lot of work on node clustering and graph classification. The problem is challenging because it is difficult to measure the similarity or distance between graphs. One feasible approach is using graph kernels to compute a similarity matrix for the graphs and then performing spectral clustering, but the effectiveness of existing graph kernels in measuring the similarity between graphs is very limited. To solve the problem, we propose a novel method called Deep Graph-Level Clustering (DGLC). DGLC utilizes a graph isomorphism network to learn graph-level representations by maximizing the mutual information between the representations of entire graphs and substructures, under the regularization of a clustering module that ensures discriminative representations via pseudo labels. DGLC achieves graph-level representation learning and graph-level clustering in an end-to-end manner. The experimental results on six benchmark datasets of graphs show that our DGLC has state-of-the-art performance in comparison to many baselines.

Benchmark Results

Tested on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
403
MLP
0.8660 ±0.0495
459
end-to-end graph-level clustering method
0.8468 ±0.0089
This paper
642
JOAO + KM
0.7920 ±0.0072
This paper
664
InfoGraph +KM
0.7795 ±0.0141
This paper
669
RW+KM
0.7766
This paper
670
RW+SC
0.7765
This paper
680
GraphCL +KM
0.7707 ±0.0121
This paper
694
SP+KM
0.7606
This paper
728
WL+KM
0.7394
This paper
729
WL-OA+KM
0.7394
This paper
730
GWF+SC
0.7392 ±0.0430
This paper
737
WL+SC
0.7340
This paper
741
GraphCL +SC
0.7322 ±0.0266
This paper
743
SP+SC
0.7287
This paper
747
InfoGraph +SC
0.7258 ±0.0483
This paper
757
JOAO + SC
0.7072 ±0.0285
This paper
767
WL-OA+SC
0.6755
This paper
769
GK+SC
0.6702
This paper
771
GWF+KM
0.6694 ±0.0768
This paper
791
LT+SC
0.5660 ±0.0488
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
0.9727
131
GraphSAGE
0.8200 ±0.0100
563
end-to-end graph-level clustering method
0.5769 ±0.0231
This paper
569
GraphCL +SC
0.5593 ±0.0124
This paper
570
GraphCL +KM
0.5537 ±0.0166
This paper
572
InfoGraph +SC
0.5487 ±0.0168
This paper
574
InfoGraph +KM
0.5411 ±0.0215
This paper
577
JOAO + SC
0.5148 ±0.0298
This paper
578
JOAO + KM
0.5112 ±0.0037
This paper
579
SP+SC
0.5010
This paper
580
WL+SC
0.5005
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9792
2
MSH-GNN
0.9640 ±0.0070
3
CoCN
0.8722 ±0.0013
23
GCN
0.8260 ±0.0220
151
MLP
0.7920 ±0.0240
327
end-to-end graph-level clustering method
0.6115 ±0.0144
This paper
328
InfoGraph +SC
0.6092 ±0.0249
This paper
329
InfoGraph +KM
0.5964 ±0.0178
This paper
333
JOAO + KM
0.5834 ±0.0146
This paper
335
GraphCL +KM
0.5802 ±0.0122
This paper
336
JOAO + SC
0.5784 ±0.0088
This paper
337
GraphCL +SC
0.5783 ±0.0061
This paper
343
WL+SC
0.5320
This paper
349
SP+SC
0.4872
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers)