Mixed Graph Contrastive Network for Semi-Supervised Node Classification

Xihong Yang, Yiqi Wang, Yue Liu, Yi Wen, Lingyuan Meng, Sihang Zhou, Xinwang Liu, En Zhu

Main figure for Mixed Graph Contrastive Network for Semi-Supervised Node Classification

Abstract

Graph Neural Networks (GNNs) have achieved promising performance in semi-supervised node classification in recent years. However, the problem of insufficient supervision, together with representation collapse, largely limits the performance of the GNNs in this field. To alleviate the collapse of node representations in semi-supervised scenario, we propose a novel graph contrastive learning method, termed Mixed Graph Contrastive Network (MGCN). In our method, we improve the discriminative capability of the latent embeddings by an interpolation-based augmentation strategy and a correlation reduction mechanism. Specifically, we first conduct the interpolation-based augmentation in the latent space and then force the prediction model to change linearly between samples. Second, we enable the learned network to tell apart samples across two interpolation-perturbed views through forcing the correlation matrix across views to approximate an identity matrix. By combining the two settings, we extract rich supervision information from both the abundant unlabeled nodes and the rare yet valuable labeled nodes for discriminative representation learning. Extensive experimental results on six datasets demonstrate the effectiveness and the generality of MGCN compared to the existing state-of-the-art methods. The code of MGCN is available at https://github.com/xihongyang1999/MGCN on Github.

Proposed method: MGCN

Benchmark Results

Tested on 6 datasets SOTA at publication on 1 35 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #771 750 places worse
0.9004
best reported
actual #21 vs paper #771 750 places worse
paper 0.7521 ±0.0038
paper 0.7521 ±0.0038 Δ at pub 0.1196 Δ today 0.1483
39
SAGE
0.8911 ±0.0012
44
GAT
actual #44 vs paper #742 698 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #742 698 places worse
paper 0.7670 ±0.0042
paper 0.7670 ±0.0042 Δ at pub 0.1220 Δ today 0.1227
77
GPRGNN
actual #77 vs paper #674 597 places worse
0.8826 ±0.0050
best reported
actual #77 vs paper #674 597 places worse
paper 0.7951 ±0.0036
paper 0.7951 ±0.0036 Δ today 0.0875
108
APPNP
actual #108 vs paper #679 571 places worse
0.8787
best reported
actual #108 vs paper #679 571 places worse
paper 0.7941 ±0.0038
best at pub: Orthogonal Graph Neural Networks (AAAI 2021)
paper 0.7941 ±0.0038 Δ at pub 0.0846 Δ today 0.0846
130
BGRL
actual #130 vs paper #699 569 places worse
0.8730 ±0.0010
best reported
actual #130 vs paper #699 569 places worse
paper 0.7887 ±0.0041
paper 0.7887 ±0.0041 Δ at pub 0.0257 Δ today 0.0843
134
GRACE
actual #134 vs paper #706 572 places worse
0.8720 ±0.0020
best reported
actual #134 vs paper #706 572 places worse
paper 0.7862 ±0.0062
141
GraphSAGE
actual #141 vs paper #813 672 places worse
0.8708 ±0.0085
best reported
actual #141 vs paper #813 672 places worse
paper 0.7089 ±0.0054
156
MVGRL
actual #156 vs paper #713 557 places worse
0.8680 ±0.0050
best reported
actual #156 vs paper #713 557 places worse
paper 0.7806 ±0.0007
160
GCN-Cheby
actual #160 vs paper #811 651 places worse
0.8676 ±0.0095
best reported
actual #160 vs paper #811 651 places worse
paper 0.7139 ±0.0051
177
DGI
actual #177 vs paper #790 613 places worse
0.8630 ±0.0020
best reported
actual #177 vs paper #790 613 places worse
paper 0.7374 ±0.0143
195
JK-Net
actual #195 vs paper #795 600 places worse
0.8579 ±0.0001
best reported
actual #195 vs paper #795 600 places worse
paper 0.7322 ±0.0064
paper 0.7322 ±0.0064 Δ at pub 0.0858 Δ today 0.1257
223
SGC
actual #223 vs paper #813 590 places worse
0.8509 ±0.0648
best reported
actual #223 vs paper #813 590 places worse
paper 0.7081 ±0.0067
307
GraphMix
actual #307 vs paper #706 399 places worse
0.8394 ±0.0057
best reported
actual #307 vs paper #706 399 places worse
paper 0.7854 ±0.0032
paper 0.7854 ±0.0032 Δ at pub 0.0540
415
GCA
actual #415 vs paper #781 366 places worse
0.8310 ±0.0030
best reported
actual #415 vs paper #781 366 places worse
paper 0.7449 ±0.0370
paper 0.7449 ±0.0370 Δ at pub 0.0758 Δ today 0.0861
587
MGCN
actual #587 vs paper #616 29 places worse
0.8123 ±0.0043
best reported
actual #587 vs paper #616 29 places worse
paper 0.8089 ±0.0095

Difference within reported uncertainty; not counted as underperformance.

paper 0.8089 ±0.0095 Δ today 0.0034
724
MLP
actual #724 vs paper #899 175 places worse
0.7768
best reported
actual #724 vs paper #899 175 places worse
paper 0.5034 ±0.0048
paper 0.5034 ±0.0048 Δ at pub 0.2380 Δ today 0.2734
738
Graph Mixup
0.7716 ±0.0112
This paper
847
MixupForGraph
0.6711 ±0.0063
This paper
871
AdaGCN
0.6241 ±0.0184
This paper
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
20
APPNP
actual #20 vs paper #670 650 places worse
0.8142 ±0.0026
best reported
actual #20 vs paper #670 650 places worse
paper 0.6859 ±0.0030
paper 0.6859 ±0.0030 Δ at pub 0.1191 Δ today 0.1283
32
GPRGNN
actual #32 vs paper #698 666 places worse
0.8102 ±0.0071
best reported
actual #32 vs paper #698 666 places worse
paper 0.6763 ±0.0038
paper 0.6763 ±0.0038 Δ today 0.1339
35
GAT
actual #35 vs paper #713 678 places worse
0.8080 ±0.0026
best reported
actual #35 vs paper #713 678 places worse
paper 0.6720 ±0.0046
paper 0.6720 ±0.0046 Δ at pub 0.1293 Δ today 0.1360
44
GCN
actual #44 vs paper #708 664 places worse
0.8033 ±0.0088
best reported
actual #44 vs paper #708 664 places worse
paper 0.6730 ±0.0035
paper 0.6730 ±0.0035 Δ at pub 0.1213 Δ today 0.1303
61
GraphSAGE
actual #61 vs paper #819 758 places worse
0.7923 ±0.0053
best reported
actual #61 vs paper #819 758 places worse
paper 0.6152 ±0.0044
paper 0.6152 ±0.0044 Δ at pub 0.1771
66
DGI
actual #66 vs paper #766 700 places worse
0.7890 ±0.0020
best reported
actual #66 vs paper #766 700 places worse
paper 0.6543 ±0.0294
87
MVGRL
actual #87 vs paper #687 600 places worse
0.7808 ±0.0006
best reported
actual #87 vs paper #687 600 places worse
paper 0.6798 ±0.0005
96
SGC
actual #96 vs paper #838 742 places worse
0.7765 ±0.0012
best reported
actual #96 vs paper #838 742 places worse
paper 0.5889 ±0.0047
136
BGRL
actual #136 vs paper #695 559 places worse
0.7600 ±0.0020
best reported
actual #136 vs paper #695 559 places worse
paper 0.6778 ±0.0085
paper 0.6778 ±0.0085 Δ at pub 0.0404 Δ today 0.0822
191
GraphMix
actual #191 vs paper #742 551 places worse
0.7470 ±0.0059
best reported
actual #191 vs paper #742 551 places worse
paper 0.6624 ±0.0074
paper 0.6624 ±0.0074 Δ at pub 0.0846
201
GRACE
actual #201 vs paper #731 530 places worse
0.7450 ±0.0010
best reported
actual #201 vs paper #731 530 places worse
paper 0.6654 ±0.0001
259
SAGE
0.7361 ±0.0190
350
MLP
actual #350 vs paper #861 511 places worse
0.7289 ±0.0010
best reported
actual #350 vs paper #861 511 places worse
paper 0.5288 ±0.0051
paper 0.5288 ±0.0051 Δ at pub 0.1670 Δ today 0.2001
505
GCA
actual #505 vs paper #742 237 places worse
0.7150 ±0.0030
best reported
actual #505 vs paper #742 237 places worse
paper 0.6625 ±0.0394

Difference within reported uncertainty; not counted as underperformance.

paper 0.6625 ±0.0394 Δ at pub 0.0508 Δ today 0.0525
578
JK-Net
actual #578 vs paper #824 246 places worse
0.7070 ±0.0070
best reported
actual #578 vs paper #824 246 places worse
paper 0.6085 ±0.0076
paper 0.6085 ±0.0076 Δ at pub 0.0985
647
MGCN
0.6918 ±0.0043
This paper
701
Graph Mixup
0.6753 ±0.0087
This paper
764
GCN-Cheby
0.6567 ±0.0038
This paper
811
AdaGCN
0.6258 ±0.0144
This paper
846
MixupForGraph
0.5741 ±0.0033
This paper

Heterogeneous Graph Benchmarks

#ModelMicro-F1 ↑Paper
1
LMSPS
0.9566 ±0.0020
2
PSHGCN
0.9561 ±0.0012
3
RpHGNN
0.9555 ±0.0029
21
GCN
actual #21 vs paper #174 153 places worse
0.9460 ±0.0031
best reported
actual #21 vs paper #174 153 places worse
paper 0.6764 ±0.0038
23
GAT
actual #23 vs paper #171 148 places worse
0.9448 ±0.0022
best reported
actual #23 vs paper #171 148 places worse
paper 0.6858 ±0.0042
best at pub: Heterogeneous Graph Benchmarks (KDD 2021)
paper 0.6858 ±0.0042 Δ at pub 0.2481 Δ today 0.2590
46
GraphSAGE
actual #46 vs paper #192 146 places worse
0.9306 ±0.0047
best reported
actual #46 vs paper #192 146 places worse
paper 0.2949 ±0.0003
paper 0.2949 ±0.0003 Δ at pub 0.5524 Δ today 0.6357
50
MVGRL
actual #50 vs paper #174 124 places worse
0.9289
best reported
actual #50 vs paper #174 124 places worse
paper 0.6789 ±0.0034
paper 0.6789 ±0.0034 Δ at pub 0.2500
60
GPRGNN
actual #60 vs paper #174 114 places worse
0.9245 ±0.0076
best reported
actual #60 vs paper #174 114 places worse
paper 0.6784 ±0.0030
paper 0.6784 ±0.0030 Δ today 0.2461
74
GRACE
actual #74 vs paper #171 97 places worse
0.9128 ±0.0007
best reported
actual #74 vs paper #171 97 places worse
paper 0.6888 ±0.0004
paper 0.6888 ±0.0004 Δ today 0.2240
79
DGI
actual #79 vs paper #169 90 places worse
0.9016 ±0.0060
best reported
actual #79 vs paper #169 90 places worse
paper 0.6890 ±0.0134
best at pub: Implicit Graph Neural Networks (NeurIPS 2020)
paper 0.6890 ±0.0134 Δ at pub 0.0310 Δ today 0.2126
88
GIN
0.8720
111
APPNP
actual #111 vs paper #174 63 places worse
0.8440 ±0.0017
best reported
actual #111 vs paper #174 63 places worse
paper 0.6775 ±0.0044
paper 0.6775 ±0.0044 Δ at pub 0.1665
112
GCA
actual #112 vs paper #180 68 places worse
0.8399 ±0.0021
best reported
actual #112 vs paper #180 68 places worse
paper 0.6011 ±0.0194
paper 0.6011 ±0.0194 Δ today 0.2388
130
BGRL
actual #130 vs paper #172 42 places worse
0.8070
best reported
actual #130 vs paper #172 42 places worse
paper 0.6848 ±0.0056
paper 0.6848 ±0.0056 Δ today 0.1222
166
MGCN
actual #166 vs paper #167 1 place worse
0.7130
best reported
actual #166 vs paper #167 1 place worse
paper 0.7060 ±0.0076
best at pub: Implicit Graph Neural Networks (NeurIPS 2020)
paper 0.7060 ±0.0076 Δ at pub 0.0070
168
AdaGCN
0.6970 ±0.0135
This paper
172
MixupForGraph
0.6851 ±0.0078
This paper
173
Graph Mixup
0.6848 ±0.0152
This paper
174
GraphMix
0.6798 ±0.0036
This paper
175
JK-Net
0.6451 ±0.0053
This paper
176
MLP
actual #176 vs paper #176
0.6447 ±0.0136
best reported
actual #176 vs paper #176
paper 0.6307 ±0.0233

Difference within reported uncertainty; not counted as underperformance.

paper 0.6307 ±0.0233 Δ today 0.0140
177
SGC
actual #177 vs paper #185 8 places worse
0.6230 ±0.0009
best reported
actual #177 vs paper #185 8 places worse
paper 0.5366 ±0.0215
paper 0.5366 ±0.0215 Δ today 0.0864
180
GCN-Cheby
0.6048
This paper

ACM

Global leaderboard →

Default metric is Micro-F1. The paper reports 19 values on Micro-F1 and 1 value on Accuracy .

#ModelMicro-F1 ↑ defaultAccuracy ↑Paper
1
LMSPS
0.9469 ± 0.0036
—
2
PSHGCN
0.9427 ± 0.0023
—
3
SlotGAT
0.9406 ± 0.0022
—
19
GAT
0.9273
best reported
—
Accuracy —
paper 0.8388 ±0.0035
paper 0.8388 ±0.0035 Δ at pub 0.0885
29
GCN
0.9229
best reported
—
Accuracy —
paper 0.8495 ±0.0021
paper 0.8495 ±0.0021 Δ at pub 0.0734
30
GPRGNN
0.9228 ±0.0027
best reported
—
Accuracy —
paper 0.8093 ±0.0226
paper 0.8093 ±0.0226 Δ today 0.1135
31
SGC
0.9224
best reported
—
Accuracy —
paper 0.7299 ±0.0296
paper 0.7299 ±0.0296 Δ at pub 0.1925
49
GIN
0.9092
—
52
GraphSAGE
0.9063 ±0.0076
best reported
—
Accuracy —
paper 0.3765 ±0.0001
paper 0.3765 ±0.0001 Δ today 0.5298
74
DGI
0.8844 ±0.0030
best reported
—
Accuracy —
paper 0.8126 ±0.0148
best at pub: Implicit Graph Neural Networks (NeurIPS 2020)
paper 0.8126 ±0.0148 Δ at pub 0.0684 Δ today 0.0718
79
MVGRL
0.8803 ±0.0138
best reported
—
Accuracy —
paper 0.8378 ±0.0027
paper 0.8378 ±0.0027 Δ today 0.0425
81
MGCN
0.8788 ±0.0054
0.8788 ± 0.0054
Accuracy 0.8788 ± 0.0054
paper 0.8788 ±0.0054
prev best: Implicit Graph Neural Networks (NeurIPS 2020)
paper 0.8788 ±0.0054 Δ at pub 0.0188
84
GRACE
0.8764 ±0.0031
best reported
—
Accuracy —
paper 0.8593 ±0.0056
paper 0.8593 ±0.0056 Δ today 0.0171
88
Graph Mixup
0.8644 ± 0.0125
—
Accuracy —
This paper
89
MixupForGraph
0.8624 ± 0.0062
—
Accuracy —
This paper
90
AdaGCN
0.8609 ± 0.0199
—
Accuracy —
This paper
93
BGRL
0.8604 ± 0.0067
—
Accuracy —
This paper
94
GraphMix
0.8575 ± 0.0055
—
Accuracy —
This paper
101
JK-Net
0.8120 ± 0.0011
—
Accuracy —
This paper
103
GCN-Cheby
0.7998 ± 0.0307
—
Accuracy —
This paper
104
GCA
0.7923 ± 0.0173
—
Accuracy —
This paper
106
APPNP
0.7461 ± 0.0067
—
Accuracy —
This paper
109
MLP
0.7102 ± 0.0221
—
Accuracy —
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere