KDD 2023

HomoGCL: Rethinking Homophily in Graph Contrastive Learning

Wenzhong Li, Changdong Wang, Hui Xiong, Jian-Huang Lai

Main figure for HomoGCL: Rethinking Homophily in Graph Contrastive Learning

Abstract

Contrastive learning (CL) has become the de-facto learning paradigm in self-supervised learning on graphs, which generally follows the ``augmenting-contrasting'' learning scheme. However, we observe that unlike CL in computer vision domain, CL in graph domain performs decently even without augmentation. We conduct a systematic analysis of this phenomenon and argue that homophily, i.e., the principle that ``like attracts like'', plays a key role in the success of graph CL. Inspired to leverage this property explicitly, we propose HomoGCL, a model-agnostic framework to expand the positive set using neighbor nodes with neighbor-specific significances. Theoretically, HomoGCL introduces a stricter lower bound of the mutual information between raw node features and node embeddings in augmented views. Furthermore, HomoGCL can be combined with existing graph CL models in a plug-and-play way with light extra computational overhead. Extensive experiments demonstrate that HomoGCL yields multiple state-of-the-art results across six public datasets and consistently brings notable performance improvements when applied to various graph CL methods. Code is avilable at.

Benchmark Results

Tested on 5 datasets 58 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #573 552 places worse
0.9004
best reported
actual #21 vs paper #573 552 places worse
paper 0.8150 ±0.0040
paper 0.8150 ±0.0040 Δ at pub 0.0567 Δ today 0.0854
39
SAGE
0.8911 ±0.0012
44
GAT
actual #44 vs paper #424 380 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #424 380 places worse
paper 0.8300 ±0.0070
paper 0.8300 ±0.0070 Δ at pub 0.0590 Δ today 0.0597
130
BGRL
actual #130 vs paper #447 317 places worse
0.8730 ±0.0010
best reported
actual #130 vs paper #447 317 places worse
paper 0.8270 ±0.0060
paper 0.8270 ±0.0060 Δ at pub 0.0460
134
GRACE
actual #134 vs paper #573 439 places worse
0.8720 ±0.0020
best reported
actual #134 vs paper #573 439 places worse
paper 0.8150 ±0.0030
paper 0.8150 ±0.0030 Δ at pub 0.0570
156
MVGRL
actual #156 vs paper #365 209 places worse
0.8680 ±0.0050
best reported
actual #156 vs paper #365 209 places worse
paper 0.8350 ±0.0040
177
DGI
actual #177 vs paper #486 309 places worse
0.8630 ±0.0020
best reported
actual #177 vs paper #486 309 places worse
paper 0.8230 ±0.0060
paper 0.8230 ±0.0060 Δ at pub 0.0400
218
GMI
actual #218 vs paper #424 206 places worse
0.8526 ±0.0008
best reported
actual #218 vs paper #424 206 places worse
paper 0.8300 ±0.0030
248
CCA-SSG
actual #248 vs paper #303 55 places worse
0.8460 ±0.0070
best reported
actual #248 vs paper #303 55 places worse
paper 0.8400 ±0.0040

Difference within reported uncertainty; not counted as underperformance.

paper 0.8400 ±0.0040 Δ at pub 0.0060
253
HomoGCL
0.8450 ±0.0050
This paper
271
COSTA
actual #271 vs paper #507 236 places worse
0.8430 ±0.0020
best reported
actual #271 vs paper #507 236 places worse
paper 0.8220 ±0.0020
paper 0.8220 ±0.0020 Δ today 0.0210
369
InfoGCL
0.8350 ±0.0030
This paper
404
AFGRL
actual #404 vs paper #666 262 places worse
0.8320 ±0.0040
best reported
actual #404 vs paper #666 262 places worse
paper 0.7980 ±0.0020
paper 0.7980 ±0.0020 Δ today 0.0340
415
GCA
actual #415 vs paper #578 163 places worse
0.8310 ±0.0030
best reported
actual #415 vs paper #578 163 places worse
paper 0.8140 ±0.0030
paper 0.8140 ±0.0030 Δ at pub 0.0170
427
ARIEL
0.8300 ±0.0130
This paper
435
DeepWalk
actual #435 vs paper #814 379 places worse
0.8290
best reported
actual #435 vs paper #814 379 places worse
paper 0.7070 ±0.0060
paper 0.7070 ±0.0060 Δ at pub 0.1220
593
ProGCL
0.8120 ±0.0040
This paper
630
VGAE
actual #630 vs paper #796 166 places worse
0.8059 ±0.0035
best reported
actual #630 vs paper #796 166 places worse
paper 0.7300 ±0.0030
paper 0.7300 ±0.0030 Δ at pub 0.0759
645
Node2Vec
actual #645 vs paper #819 174 places worse
0.8030
best reported
actual #645 vs paper #819 174 places worse
paper 0.7010 ±0.0040
paper 0.7010 ±0.0040 Δ at pub 0.1020
654
GAE
actual #654 vs paper #810 156 places worse
0.8011 ±0.0022
best reported
actual #654 vs paper #810 156 places worse
paper 0.7150 ±0.0040
paper 0.7150 ±0.0040 Δ at pub 0.0861
724
MLP
0.7768
856
Raw features
actual #856 vs paper #904 48 places worse
0.6530
best reported
actual #856 vs paper #904 48 places worse
paper 0.4770 ±0.0040
paper 0.4770 ±0.0040 Δ today 0.1760
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
35
GAT
actual #35 vs paper #388 353 places worse
0.8080 ±0.0026
best reported
actual #35 vs paper #388 353 places worse
paper 0.7250 ±0.0070
paper 0.7250 ±0.0070 Δ at pub 0.0830
44
GCN
actual #44 vs paper #610 566 places worse
0.8033 ±0.0088
best reported
actual #44 vs paper #610 566 places worse
paper 0.7020 ±0.0040
paper 0.7020 ±0.0040 Δ at pub 0.0923 Δ today 0.1013
61
GraphSAGE
0.7923 ±0.0053
66
DGI
actual #66 vs paper #474 408 places worse
0.7890 ±0.0020
best reported
actual #66 vs paper #474 408 places worse
paper 0.7180 ±0.0070
paper 0.7180 ±0.0070 Δ at pub 0.0710
73
GMI
actual #73 vs paper #409 336 places worse
0.7869 ±0.0016
best reported
actual #73 vs paper #409 336 places worse
paper 0.7240 ±0.0010
87
MVGRL
actual #87 vs paper #292 205 places worse
0.7808 ±0.0006
best reported
actual #87 vs paper #292 205 places worse
paper 0.7330 ±0.0050
136
BGRL
actual #136 vs paper #550 414 places worse
0.7600 ±0.0020
best reported
actual #136 vs paper #550 414 places worse
paper 0.7110 ±0.0080
paper 0.7110 ±0.0080 Δ at pub 0.0490
165
CCA-SSG
actual #165 vs paper #316 151 places worse
0.7540 ±0.0100
best reported
actual #165 vs paper #316 151 places worse
paper 0.7310 ±0.0030
paper 0.7310 ±0.0030 Δ at pub 0.0230
201
GRACE
actual #201 vs paper #584 383 places worse
0.7450 ±0.0010
best reported
actual #201 vs paper #584 383 places worse
paper 0.7060 ±0.0050
paper 0.7060 ±0.0050 Δ at pub 0.0390
273
InfoGCL
0.7350 ±0.0040
This paper
337
COSTA
actual #337 vs paper #577 240 places worse
0.7290 ±0.0030
best reported
actual #337 vs paper #577 240 places worse
paper 0.7070 ±0.0050
paper 0.7070 ±0.0050 Δ today 0.0220
350
MLP
0.7289 ±0.0010
374
AFGRL
actual #374 vs paper #639 265 places worse
0.7260 ±0.0030
best reported
actual #374 vs paper #639 265 places worse
paper 0.6940 ±0.0020
paper 0.6940 ±0.0020 Δ today 0.0320
427
HomoGCL
0.7230 ±0.0070
This paper
505
GCA
actual #505 vs paper #596 91 places worse
0.7150 ±0.0030
best reported
actual #505 vs paper #596 91 places worse
paper 0.7040 ±0.0040
551
ARIEL
0.7110 ±0.0090
This paper
583
ProGCL
actual #583 vs paper #630 47 places worse
0.7063 ±0.0022
best reported
actual #583 vs paper #630 47 places worse
paper 0.6980 ±0.0050
best today: Negative Metric Learning for Graphs (IJCAI 2025)
paper 0.6980 ±0.0050 Δ today 0.0083
625
VGAE
actual #625 vs paper #675 50 places worse
0.6990 ±0.0057
best reported
actual #625 vs paper #675 50 places worse
paper 0.6830 ±0.0040
paper 0.6830 ±0.0040 Δ at pub 0.0160
692
DeepWalk
actual #692 vs paper #864 172 places worse
0.6785 ±0.0079
best reported
actual #692 vs paper #864 172 places worse
paper 0.5140 ±0.0050
paper 0.5140 ±0.0050 Δ at pub 0.1645
709
Raw features
actual #709 vs paper #872 163 places worse
0.6730
best reported
actual #709 vs paper #872 163 places worse
paper 0.4650 ±0.0040
739
GAE
actual #739 vs paper #757 18 places worse
0.6639 ±0.0024
best reported
actual #739 vs paper #757 18 places worse
paper 0.6580 ±0.0040
paper 0.6580 ±0.0040 Δ at pub 0.0059
766
Node2Vec
actual #766 vs paper #865 99 places worse
0.6552 ±0.0018
best reported
actual #766 vs paper #865 99 places worse
paper 0.4980 ±0.0030
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
actual #18 vs paper #585 567 places worse
0.9296 ±0.0015
best reported
actual #18 vs paper #585 567 places worse
paper 0.7900 ±0.0020
20
GAT
actual #20 vs paper #585 565 places worse
0.9233 ±0.0018
best reported
actual #20 vs paper #585 565 places worse
paper 0.7900 ±0.0030
116
SAGE
0.8881 ±0.0015
136
CCA-SSG
actual #136 vs paper #371 235 places worse
0.8840 ±0.0060
best reported
actual #136 vs paper #371 235 places worse
paper 0.8100 ±0.0040
paper 0.8100 ±0.0040 Δ at pub 0.0740
144
BGRL
actual #144 vs paper #487 343 places worse
0.8830 ±0.0010
best reported
actual #144 vs paper #487 343 places worse
paper 0.7960 ±0.0050
paper 0.7960 ±0.0050 Δ at pub 0.0870
194
GRACE
actual #194 vs paper #428 234 places worse
0.8730 ±0.0010
best reported
actual #194 vs paper #428 234 places worse
paper 0.8020 ±0.0030
paper 0.8020 ±0.0030 Δ at pub 0.0710
195
GMI
actual #195 vs paper #458 263 places worse
0.8726 ±0.0016
best reported
actual #195 vs paper #458 263 places worse
paper 0.7990 ±0.0020
196
MVGRL
actual #196 vs paper #439 243 places worse
0.8725 ±0.0012
best reported
actual #196 vs paper #439 243 places worse
paper 0.8010 ±0.0070
204
DGI
actual #204 vs paper #745 541 places worse
0.8708 ±0.0017
best reported
actual #204 vs paper #745 541 places worse
paper 0.7680 ±0.0060
208
COSTA
actual #208 vs paper #410 202 places worse
0.8698 ±0.0033
best reported
actual #208 vs paper #410 202 places worse
paper 0.8040 ±0.0030
210
MLP
0.8690 ±0.0074
223
DeepWalk
actual #223 vs paper #807 584 places worse
0.8652 ±0.0012
best reported
actual #223 vs paper #807 584 places worse
paper 0.7430 ±0.0090
251
Node2Vec
actual #251 vs paper #838 587 places worse
0.8520 ±0.0002
best reported
actual #251 vs paper #838 587 places worse
paper 0.6980 ±0.0070
255
GCA
actual #255 vs paper #393 138 places worse
0.8512 ±0.0023
best reported
actual #255 vs paper #393 138 places worse
paper 0.8070 ±0.0050
paper 0.8070 ±0.0050 Δ at pub 0.0058 Δ today 0.0442
299
VGAE
actual #299 vs paper #775 476 places worse
0.8307 ±0.0029
best reported
actual #299 vs paper #775 476 places worse
paper 0.7580 ±0.0020
paper 0.7580 ±0.0020 Δ at pub 0.0553 Δ today 0.0727
304
GAE
actual #304 vs paper #823 519 places worse
0.8294 ±0.0031
best reported
actual #304 vs paper #823 519 places worse
paper 0.7210 ±0.0050
paper 0.7210 ±0.0050 Δ at pub 0.0979 Δ today 0.1084
365
HomoGCL
0.8110 ±0.0030
This paper
384
AFGRL
actual #384 vs paper #447 63 places worse
0.8080 ±0.0060
best reported
actual #384 vs paper #447 63 places worse
paper 0.8000 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.8000 ±0.0010 Δ today 0.0080
557
ProGCL
0.7920 ±0.0020
This paper
575
InfoGCL
0.7910 ±0.0020
This paper
808
ARIEL
0.7420 ±0.0080
This paper
828
Raw features
actual #828 vs paper #828
0.7140 ±0.0020
actual #828 vs paper #828
paper 0.7140 ±0.0020
paper 0.7140 ±0.0020 Δ at pub 0.0230
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
actual #2 vs paper #275 273 places worse
0.9669 ±0.0014
best reported
actual #2 vs paper #275 273 places worse
paper 0.9256 ±0.0035
paper 0.9256 ±0.0035 Δ at pub 0.0165 Δ today 0.0413
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
8
GCN
actual #8 vs paper #292 284 places worse
0.9632 ±0.0008
best reported
actual #8 vs paper #292 284 places worse
paper 0.9242 ±0.0022
paper 0.9242 ±0.0022 Δ at pub 0.0152 Δ today 0.0390
113
ProGCL
actual #113 vs paper #302 189 places worse
0.9381 ±0.0048
best reported
actual #113 vs paper #302 189 places worse
paper 0.9239 ±0.0011
paper 0.9239 ±0.0011 Δ today 0.0142
130
AFGRL
actual #130 vs paper #254 124 places worse
0.9361 ±0.0020
best reported
actual #130 vs paper #254 124 places worse
paper 0.9271 ±0.0023
paper 0.9271 ±0.0023 Δ at pub 0.0090
172
BGRL
actual #172 vs paper #237 65 places worse
0.9337 ±0.0021
best reported
actual #172 vs paper #237 65 places worse
paper 0.9280 ±0.0008
paper 0.9280 ±0.0008 Δ at pub 0.0057
186
CCA-SSG
actual #186 vs paper #233 47 places worse
0.9325 ±0.0021
best reported
actual #186 vs paper #233 47 places worse
paper 0.9284 ±0.0018
paper 0.9284 ±0.0018 Δ at pub 0.0041
191
GCA
actual #191 vs paper #277 86 places worse
0.9320 ±0.0060
best reported
actual #191 vs paper #277 86 places worse
paper 0.9253 ±0.0016
203
GRACE
actual #203 vs paper #324 121 places worse
0.9313 ±0.0017
best reported
actual #203 vs paper #324 121 places worse
paper 0.9215 ±0.0024
paper 0.9215 ±0.0024 Δ at pub 0.0065 Δ today 0.0098
206
MVGRL
actual #206 vs paper #359 153 places worse
0.9310 ±0.0040
best reported
actual #206 vs paper #359 153 places worse
paper 0.9174 ±0.0007
213
DGI
actual #213 vs paper #366 153 places worse
0.9309 ±0.0008
best reported
actual #213 vs paper #366 153 places worse
paper 0.9161 ±0.0022
222
HomoGCL
actual #222 vs paper #225 3 places worse
0.9300 ±0.0020
best reported
actual #222 vs paper #225 3 places worse
paper 0.9292 ±0.0018

Difference within reported uncertainty; not counted as underperformance.

paper 0.9292 ±0.0018 Δ today 0.0008
263
COSTA
actual #263 vs paper #290 27 places worse
0.9267 ±0.0016
best reported
actual #263 vs paper #290 27 places worse
paper 0.9243 ±0.0038

Difference within reported uncertainty; not counted as underperformance.

paper 0.9243 ±0.0038 Δ at pub 0.0013 Δ today 0.0024
317
VGAE
actual #317 vs paper #324 7 places worse
0.9224
best reported
actual #317 vs paper #324 7 places worse
paper 0.9220 ±0.0011

Difference within reported uncertainty; not counted as underperformance.

paper 0.9220 ±0.0011 Δ at pub 0.0004
352
GAE
actual #352 vs paper #366 14 places worse
0.9185 ±0.0006
best reported
actual #352 vs paper #366 14 places worse
paper 0.9162 ±0.0013
paper 0.9162 ±0.0013 Δ at pub 0.0023
355
ARIEL
actual #355 vs paper #355
0.9180 ±0.0024
actual #355 vs paper #355
paper 0.9180 ±0.0024
paper 0.9180 ±0.0024 Δ at pub 0.0037
390
MLP
0.9128 ±0.0063
408
GMI
actual #408 vs paper #417 9 places worse
0.9081 ±0.0015
best reported
actual #408 vs paper #417 9 places worse
paper 0.9068 ±0.0017

Difference within reported uncertainty; not counted as underperformance.

paper 0.9068 ±0.0017 Δ at pub 0.0005 Δ today 0.0013
444
DeepWalk
actual #444 vs paper #464 20 places worse
0.9005 ±0.0008
best reported
actual #444 vs paper #464 20 places worse
paper 0.8944 ±0.0011
paper 0.8944 ±0.0011 Δ at pub 0.0061 Δ today 0.0061
457
Node2Vec
actual #457 vs paper #491 34 places worse
0.8970 ±0.0010
best reported
actual #457 vs paper #491 34 places worse
paper 0.8776 ±0.0010
paper 0.8776 ±0.0010 Δ at pub 0.0194 Δ today 0.0194
531
Raw features
actual #531 vs paper #555 24 places worse
0.7999 ±0.0090
best reported
actual #531 vs paper #555 24 places worse
paper 0.7227
paper 0.7227 Δ at pub 0.0626 Δ today 0.0772
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9461 ±0.0017
2
GCN
actual #2 vs paper #269 267 places worse
0.9412 ±0.0008
best reported
actual #2 vs paper #269 267 places worse
paper 0.8651 ±0.0054
paper 0.8651 ±0.0054 Δ at pub 0.0321 Δ today 0.0761
3
GAT
actual #3 vs paper #256 253 places worse
0.9398 ±0.0022
best reported
actual #3 vs paper #256 253 places worse
paper 0.8693 ±0.0029
paper 0.8693 ±0.0029 Δ at pub 0.0281 Δ today 0.0705
8
SAGE
0.9351 ±0.0006
79
BGRL
actual #79 vs paper #199 120 places worse
0.9034 ±0.0019
best reported
actual #79 vs paper #199 120 places worse
paper 0.8823 ±0.0011
paper 0.8823 ±0.0011 Δ at pub 0.0211 Δ today 0.0211
101
BGRL + HomoGCL
0.9001
This paper
112
AFGRL
actual #112 vs paper #203 91 places worse
0.8988 ±0.0033
best reported
actual #112 vs paper #203 91 places worse
paper 0.8812 ±0.0027
paper 0.8812 ±0.0027 Δ at pub 0.0176 Δ today 0.0176
135
ProGCL
actual #135 vs paper #238 103 places worse
0.8955 ±0.0016
best reported
actual #135 vs paper #238 103 places worse
paper 0.8743 ±0.0021
paper 0.8743 ±0.0021 Δ today 0.0212
139
GRACE
actual #139 vs paper #282 143 places worse
0.8953 ±0.0035
best reported
actual #139 vs paper #282 143 places worse
paper 0.8625 ±0.0025
paper 0.8625 ±0.0025 Δ at pub 0.0328 Δ today 0.0328
157
HomoGCL
actual #157 vs paper #186 29 places worse
0.8900 ±0.0010
best reported
actual #157 vs paper #186 29 places worse
paper 0.8846 ±0.0020
paper 0.8846 ±0.0020 Δ today 0.0054
159
CCA-SSG
actual #159 vs paper #197 38 places worse
0.8896 ±0.0013
best reported
actual #159 vs paper #197 38 places worse
paper 0.8827 ±0.0032
paper 0.8827 ±0.0032 Δ at pub 0.0047 Δ today 0.0069
160
GCA
actual #160 vs paper #217 57 places worse
0.8894 ±0.0015
best reported
actual #160 vs paper #217 57 places worse
paper 0.8780 ±0.0023
paper 0.8780 ±0.0023 Δ at pub 0.0114 Δ today 0.0114
179
MVGRL
actual #179 vs paper #235 56 places worse
0.8861 ±0.0064
best reported
actual #179 vs paper #235 56 places worse
paper 0.8752 ±0.0011
192
COSTA
actual #192 vs paper #192
0.8837 ±0.0022
actual #192 vs paper #192
paper 0.8837 ±0.0022

Improvement within reported uncertainty; not highlighted.

paper 0.8837 ±0.0022 Δ at pub 0.0005
210
DGI
actual #210 vs paper #354 144 places worse
0.8798 ±0.0081
best reported
actual #210 vs paper #354 144 places worse
paper 0.8395 ±0.0047
246
VGAE
actual #246 vs paper #274 28 places worse
0.8721 ±0.0026
best reported
actual #246 vs paper #274 28 places worse
paper 0.8637 ±0.0021
paper 0.8637 ±0.0021 Δ at pub 0.0007 Δ today 0.0084
253
ARIEL
0.8707 ±0.0033
This paper
264
GAE
actual #264 vs paper #305 41 places worse
0.8666 ±0.0007
best reported
actual #264 vs paper #305 41 places worse
paper 0.8527 ±0.0019
paper 0.8527 ±0.0019 Δ at pub 0.0139
278
DeepWalk
actual #278 vs paper #296 18 places worse
0.8628 ±0.0007
best reported
actual #278 vs paper #296 18 places worse
paper 0.8568 ±0.0006
paper 0.8568 ±0.0006 Δ at pub 0.0060 Δ today 0.0060
320
MLP
0.8463
330
Node2Vec
actual #330 vs paper #334 4 places worse
0.8440 ±0.0010
best reported
actual #330 vs paper #334 4 places worse
paper 0.8439 ±0.0008

Difference within reported uncertainty; not counted as underperformance.

paper 0.8439 ±0.0008 Δ at pub 0.0001 Δ today 0.0001
342
GMI
actual #342 vs paper #398 56 places worse
0.8422 ±0.0052
best reported
actual #342 vs paper #398 56 places worse
paper 0.8221 ±0.0031
paper 0.8221 ±0.0031 Δ at pub 0.0201
456
Raw features
0.7381
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere