Community-Invariant Graph Contrastive Learning
Abstract
Graph augmentation has received great attention in recent years for graph contrastive learning (GCL) to learn well-generalized node/graph representations. However, mainstream GCL methods often favor randomly disrupting graphs for augmentation, which shows limited generalization and inevitably leads to the corruption of high-level graph information, i.e., the graph community. Moreover, current knowledge-based graph augmentation methods can only focus on either topology or node features, causing the model to lack robustness against various types of noise. To address these limitations, this research investigated the role of the graph community in graph augmentation and figured out its crucial advantage for learnable graph augmentation. Based on our observations, we propose a community-invariant GCL framework to maintain graph community structure during learnable graph augmentation. By maximizing the spectral changes, this framework unifies the constraints of both topology and feature augmentation, enhancing the model's robustness. Empirical evidence on 21 benchmark datasets demonstrates the exclusive merits of our framework. Code is released on Github (https://github.com/ShiyinTan/CI-GCL.git).
Benchmark Results
Tested on 12 datasets 18 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 | |
| 155 | GCS | 0.9045
±0.0081 best reported | |
| 178 | AD-GCL | 0.9028
±0.0401 best reported | best at pub: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) Difference within reported uncertainty; not counted as underperformance. |
| 179 | SEGA | 0.9021
±0.0070 | This paper |
| 209 | CI+AD-GCL | 0.8988
±0.0070 | This paper |
| 223 | CI-GCL | 0.8967
±0.0090 | This paper |
| 257 | InfoGraph | 0.8930
±0.0514 best reported | best at pub: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 302 | AutoGCL | 0.8864
±0.0108 best reported | best at pub: GIMM: InfoMin-Max for Automated Graph Contrastive Learning (2023) |
| 351 | JOAO | 0.8770
±0.0080 best reported | best at pub: Graph Self-Supervised Learning: A Survey (2021) best today: Learning Graph Augmentations to Learn Graph Representations (2022) Difference within reported uncertainty; not counted as underperformance. |
| 400 | CI+AutoGCL | 0.8673
±0.0100 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 451 | GCL-SPAN | 0.8500
±0.0080 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 | |
| 3 | GCN | 0.9727 | |
| 104 | GraphCL | 0.8250
±0.0013 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 133 | AutoGCL | 0.8200
±0.0029 best reported | best at pub: Unifying Graph Contrastive Learning via Graph Message Augmentation (2024) |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 195 | CI-GCL | 0.8050
±0.0050 | This paper |
| 264 | SEGA | 0.7900
±0.0070 | This paper |
| 296 | CI+AutoGCL | 0.7847
±0.0070 | This paper |
| 301 | JOAO | 0.7840
±0.0050 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 338 | InfoGraph | 0.7750
±0.0074 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 344 | GCS | 0.7737
±0.0030 best reported | best today: SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samples (2024) Difference within reported uncertainty; not counted as underperformance. |
| 356 | MVGRL | 0.7700
±0.0080 best reported | best at pub: InfoGCL: Information-Aware Graph Contrastive Learning (NeurIPS 2021) best today: Graph Self-Supervised Learning with Learnable Structural and Positional Encodings (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 405 | GCL-SPAN | 0.7543
±0.0040 | This paper |
| 427 | CI+AD-GCL | 0.7435
±0.0050 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 32 | GIN | 0.7880
±0.0410 | |
| 107 | CI-GCL | 0.7650
±0.0010 | This paper |
| 146 | SEGA | 0.7601
±0.0040 | This paper |
| 149 | MLP | 0.7600
±0.0320 | |
| 169 | GCL-SPAN | 0.7578
±0.0040 | This paper |
| 245 | GCS | 0.7502
±0.0081 best reported | best today: SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samples (2024) Difference within reported uncertainty; not counted as underperformance. |
| 251 | MVGRL | 0.7500
±0.0290 best reported | best today: Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 265 | GraphCL | 0.7489
±0.0065 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 280 | CI+AD-GCL | 0.7466
±0.0060 | This paper |
| 283 | JOAO | 0.7460
±0.0040 best reported | best at pub: GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling (2024) best today: Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 294 | InfoGraph | 0.7444
±0.0030 | This paper |
| 444 | CI+AutoGCL | 0.7081
±0.0050 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 23 | GCN | 0.8260
±0.0220 | |
| 146 | InfoGraph | 0.7940 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) |
| 151 | MLP | 0.7920
±0.0240 | |
| 223 | GCL-SPAN | 0.7637
±0.0073 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) |
| 239 | GCS | 0.7556
±0.0041 best reported | |
| 264 | CI+AD-GCL | 0.7394
±0.0030 | This paper |
| 283 | CI+AutoGCL | 0.7224
±0.0090 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | OEPG | 0.9630
±0.0090 | |
| 2 | MSH-GNN | 0.9580
±0.0090 | |
| 3 | GNN-AK+ | 0.9480
±0.0080 | |
| 13 | GIN | 0.9240
±0.0250 | |
| 23 | GraphCL | 0.9169
±0.0070 best reported | best at pub: Graph Contrastive Learning with Cohesive Subgraph Awareness (WWW 2024) |
| 30 | CI-GCL | 0.9080
±0.0050 | This paper |
| 36 | SEGA | 0.9021
±0.0070 | This paper |
| 47 | AutoGCL | 0.8931
±0.0148 best reported | best at pub: Graph Contrastive Learning with Cohesive Subgraph Awareness (WWW 2024) |
| 54 | CI+AD-GCL | 0.8780
±0.0120 | This paper |
| 56 | CI+AutoGCL | 0.8750
±0.0140 | This paper |
| 57 | GCS | 0.8650
±0.0030 | This paper |
| 58 | GCL-SPAN | 0.8650
±0.0010 | This paper |
MoleculeNet
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | HIMP | 0.8740
±0.0050 | |
| 2 | GINE w/ VN | 0.8720
±0.0030 | |
| 3 | NaiveGINe+ K=3 w/ VN | 0.8700
±0.0040 | |
| 14 | GCN | 0.8400
±0.0040 | |
| 31 | JOAO | 0.8230
±0.0220 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 47 | GraphCL | 0.8050
±0.0170 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 81 | InfoGraph | 0.7930 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 165 | SEGA | 0.7670
±0.0040 | This paper |
| 204 | AutoGCL | 0.7550
±0.0030 | This paper |
| 240 | AD-GCL | 0.7470
±0.0110 best reported | best at pub: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 250 | GCS | 0.7440
±0.0040 | This paper |
| 264 | No Pre-train | 0.7400
±0.0080 | This paper |
| 272 | CI-GCL | 0.7359
±0.0066 | This paper |
| 286 | GCL-SPAN | 0.7283
±0.0062 | This paper |
| 301 | MVGRL | 0.7048
±0.0083 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | ProtoMol | 0.9140
±0.0030 | |
| 2 | MMSG | 0.9080
±0.0050 | |
| 3 | MemGNN | 0.9070 | |
| 43 | GIN | 0.8646
±0.0081 | |
| 87 | CI-GCL | 0.8440
±0.0090 | This paper |
| 100 | JOAO | 0.8340
±0.0330 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 124 | GCS | 0.8230
±0.0030 | This paper |
| 177 | GCL-SPAN | 0.7990
±0.0070 | This paper |
| 202 | AD-GCL | 0.7900
±0.0080 | prev best: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 228 | MVGRL | 0.7720
±0.0100 | This paper |
| 229 | SEGA | 0.7710
±0.0050 | This paper |
| 235 | AutoGCL | 0.7670
±0.0110 | This paper |
| 281 | No Pre-train | 0.7010
±0.0540 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | MAGPrompt+ | 0.9432
±0.0238 | |
| 2 | CamS-LLaMA | 0.9420 | |
| 3 | SE(3)-I MPPH | 0.9400
±0.0210 | |
| 34 | GIN | 0.8875
±0.0049 | |
| 70 | CI-GCL | 0.7440
±0.0190 | This paper |
| 91 | GCS | 0.7250
±0.0050 | This paper |
| 102 | AutoGCL | 0.7200
±0.0060 | This paper |
| 107 | SEGA | 0.7190
±0.0110 | This paper |
| 144 | AD-GCL | 0.7010
±0.0120 best reported | best at pub: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 152 | GCL-SPAN | 0.7000
±0.0070 | This paper |
| 180 | MVGRL | 0.6900
±0.0050 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.9930
±0.0040 | |
| 2 | KA-GCN | 0.9920
±0.0050 | |
| 3 | KA-GAT | 0.9910
±0.0050 | |
| 19 | GCN | 0.9130
±0.0170 | |
| 58 | SEGA | 0.8500
±0.0090 | This paper |
| 79 | JOAO | 0.8132
±0.0249 best reported | best at pub: Graph Self-Contrast Representation Learning (2023) Difference within reported uncertainty; not counted as underperformance. |
| 82 | AD-GCL | 0.8077
±0.0392 | prev best: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) Improvement within reported uncertainty; not highlighted. |
| 86 | GCL-SPAN | 0.8028
±0.0242 | This paper |
| 90 | AutoGCL | 0.7990
±0.0330 | This paper |
| 100 | CI-GCL | 0.7890
±0.0259 | This paper |
| 97 | GraphCL | 0.7890
±0.0420 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: Improving Molecular Pretraining with Complementary Featurizations (2022) Difference within reported uncertainty; not counted as underperformance. |
| 106 | InfoGraph | 0.7810 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 141 | MVGRL | 0.7384
±0.0425 | This paper |
| 195 | GCS | 0.6670
±0.0190 | This paper |
| 232 | No Pre-train | 0.5800
±0.0440 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | KA-GAT | 0.8470
±0.0020 | |
| 2 | KA-GCN | 0.8420
±0.0010 | |
| 3 | GraphKAN | 0.8370
±0.0010 | |
| 51 | GCL-SPAN | 0.6487
±0.0088 | This paper |
| 55 | CI-GCL | 0.6470
±0.0030 | This paper |
| 66 | GIN | 0.6403
±0.0104 | |
| 68 | JOAO | 0.6400
±0.0100 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) Difference within reported uncertainty; not counted as underperformance. |
| 74 | SEGA | 0.6370
±0.0030 | This paper |
| 98 | AutoGCL | 0.6250
±0.0060 | This paper |
| 103 | ContextPred | 0.6220
±0.0059 best reported | |
| 110 | MVGRL | 0.6194
±0.0094 | This paper |
| 111 | GCS | 0.6190
±0.0040 | This paper |
| 114 | GraphCL | 0.6176
±0.0111 | prev best: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Improvement within reported uncertainty; not highlighted. |
| 120 | Infomax | 0.6160
±0.0240 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) Difference within reported uncertainty; not counted as underperformance. |
| 133 | AttrMasking | 0.6121
±0.0065 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 146 | AD-GCL | 0.6080
±0.0090 | prev best: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 162 | InfoGraph | 0.6054
±0.0090 | prev best: A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretraining (ICML 2023) Improvement within reported uncertainty; not highlighted. |
| 170 | EdgePred | 0.6040
±0.0070 | This paper |
| 222 | No Pre-train | 0.5730
±0.0160 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | GeomGCL | 0.7630 | |
| 2 | LiGhT DeepGPT | 0.7570
±0.0110 | |
| 3 | CoMPT | 0.7550 | |
| 14 | GCN | 0.7350
±0.0020 | |
| 31 | JOAO | 0.7110
±0.0140 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 100 | CI-GCL | 0.6540
±0.0150 | This paper |
| 104 | SEGA | 0.6520
±0.0090 | This paper |
| 118 | GCS | 0.6440
±0.0020 | This paper |
| 127 | GCL-SPAN | 0.6420
±0.0040 | This paper |
| 138 | AD-GCL | 0.6350
±0.0070 | prev best: Let Invariant Rationale Discovery Inspire Graph Contrastive Learning (ICML 2022) Improvement within reported uncertainty; not highlighted. |
| 142 | No Pre-train | 0.6340
±0.0060 | This paper |
| 143 | AutoGCL | 0.6340
±0.0040 | This paper |
| 176 | MVGRL | 0.6260
±0.0050 | This paper |
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.3540
±0.0530 | |
| 2 | ECFP-4 + RF | 0.5600
±0.0660 | |
| 3 | GPSE + GPS | 0.6820 | |
| 56 | InfoGraph | 2.1040 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 69 | GIN | 2.3460
±0.1220 | |
| 91 | CI-GCL | 2.8730
±0.3200 | This paper |
| 101 | GraphCL | 3.1660
±0.0270 best reported | best at pub: 3D Infomax improves GNNs for Molecular Property Prediction (ICML 2021) |
| 104 | JOAO | 3.2820
±0.0020 best reported | |
| 121 | GCL-SPAN | 4.5310
±0.4600 | This paper |
| 124 | AD-GCL | 5.1500
±0.6200 | This paper |
| 128 | MVGRL | 9.0240
±1.9800 | This paper |
