CORE: Contrastive Masked Feature Reconstruction on Graphs
Abstract
In the rapidly evolving field of self-supervised learning on graphs, generative and contrastive methodologies have emerged as two dominant approaches. Our study focuses on masked feature reconstruction (MFR), a generative technique where a model learns to restore the raw features of masked nodes in a self-supervised manner. We observe that both MFR and graph contrastive learning (GCL) aim to maximize agreement between similar elements. Building on this observation, we reveal a novel theoretical insight: under specific conditions, the objectives of MFR and node-level GCL converge, despite their distinct operational mechanisms. This theoretical connection suggests these approaches are complementary rather than fundamentally different, prompting us to explore their integration to enhance self-supervised learning on graphs. Our research presents Contrastive Masked Feature Reconstruction (CORE), a novel graph self-supervised learning framework that integrates contrastive learning into MFR. Specifically, we form positive pairs exclusively between the original and reconstructed features of masked nodes, encouraging the encoder to prioritize contextual information over the node's own features. Additionally, we leverage the masked nodes themselves as negative samples, combining MFR's reconstructive power with GCL's discriminative ability to better capture intrinsic graph structures. Empirically, our proposed framework CORE significantly outperforms MFR across node and graph classification tasks, demonstrating state-of-the-art results. In particular, CORE surpasses GraphMAE and GraphMAE2 by up to 2.80\
Benchmark Results
Tested on 9 datasets 41 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 best reported | best at pub: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 39 | SAGE | 0.8911
±0.0012 | |
| 44 | GAT | 0.8897
±0.0014 best reported | |
| 130 | BGRL | 0.8730
±0.0010 best reported | best at pub: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 134 | GRACE | 0.8720
±0.0020 best reported | best at pub: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 156 | MVGRL | 0.8680
±0.0050 best reported | best at pub: ENGAGE: Explanation Guided Data Augmentation for Graph Representation Learning (2023) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) |
| 177 | DGI | 0.8630
±0.0020 best reported | best at pub: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 218 | GMI | 0.8526
±0.0008 best reported | |
| 248 | CCA-SSG | 0.8460
±0.0070 best reported | best at pub: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) Difference within reported uncertainty; not counted as underperformance. |
| 252 | GraphMAE2 | 0.8450
±0.0060 best reported | best at pub: Disentangled Generative Graph Representation Learning (2024) Difference within reported uncertainty; not counted as underperformance. |
| 270 | AUG-MAE | 0.8430
±0.0040 | This paper |
| 281 | CORE | 0.8420
±0.0050 | This paper |
| 280 | GraphMAE | 0.8420
±0.0040 best reported | best at pub: Disentangled Generative Graph Representation Learning (2024) best today: Discrepancy-Aware Graph Mask Auto-Encoder (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 415 | GCA | 0.8310
±0.0030 best reported | best at pub: Graph Contrastive Learning with Implicit Augmentations (2022) |
| 654 | GAE | 0.8011
±0.0022 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) |
| 724 | MLP | 0.7768 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9703
±0.0019 | |
| 2 | GAT | 0.9669
±0.0014 best reported | |
| 3 | GAT+T | 0.9660
±0.0007 | |
| 7 | SAGE | 0.9643
±0.0027 | |
| 8 | GCN | 0.9632
±0.0008 best reported | |
| 109 | CORE | 0.9390
±0.0040 | This paper |
| 149 | ABGML | 0.9350
±0.0040 | prev best: From Overfitting to Robustness: Quantity, Quality, and Variety Oriented Negative Sample Selection in Graph Contrastive Learning (2024) Improvement within reported uncertainty; not highlighted. |
| 164 | GraphMAE | 0.9341
±0.0010 best reported | best at pub: Rethinking and Simplifying Bootstrapped Graph Latents (2023) Difference within reported uncertainty; not counted as underperformance. |
| 172 | BGRL | 0.9337
±0.0021 best reported | best at pub: Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning (AAAI 2022) Difference within reported uncertainty; not counted as underperformance. |
| 186 | CCA-SSG | 0.9325
±0.0021 best reported | best at pub: Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning (AAAI 2022) Difference within reported uncertainty; not counted as underperformance. |
| 191 | GCA | 0.9320
±0.0060 best reported | best at pub: Unifying Graph Contrastive Learning with Flexible Contextual Scopes (2022) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 192 | GraphMAE2 | 0.9320
±0.0030 | This paper |
| 203 | GRACE | 0.9313
±0.0017 best reported | best at pub: Learn Beneficial Noise as Graph Augmentation (ICML 2025) Difference within reported uncertainty; not counted as underperformance. |
| 206 | MVGRL | 0.9310
±0.0040 best reported | best at pub: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 213 | DGI | 0.9309
±0.0008 best reported | |
| 352 | GAE | 0.9185
±0.0006 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) |
| 390 | MLP | 0.9128
±0.0063 | |
| 408 | GMI | 0.9081
±0.0015 best reported | best at pub: Localized Graph Contrastive Learning (2022) best today: Energy-Balanced Hyperspherical Graph Representation Learning via Structural Binding and Entropic Dispersion (2025) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9461
±0.0017 | |
| 2 | GCN | 0.9412
±0.0008 best reported | best at pub: Diss-l-ECT: Dissecting Graph Data with local Euler Characteristic Transforms (ICML 2024) |
| 3 | GAT | 0.9398
±0.0022 best reported | best at pub: Diss-l-ECT: Dissecting Graph Data with local Euler Characteristic Transforms (ICML 2024) |
| 8 | SAGE | 0.9351
±0.0006 | |
| 56 | CORE | 0.9100
±0.0030 | This paper |
| 79 | BGRL | 0.9034
±0.0019 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) Difference within reported uncertainty; not counted as underperformance. |
| 84 | ABGML | 0.9020
±0.0030 | This paper |
| 100 | GraphMAE | 0.9002
±0.0024 best reported | best at pub: Discrepancy-Aware Graph Mask Auto-Encoder (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 111 | GraphMAE2 | 0.8990
±0.0030 | prev best: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) Improvement within reported uncertainty; not highlighted. |
| 139 | GRACE | 0.8953
±0.0035 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) Difference within reported uncertainty; not counted as underperformance. |
| 159 | CCA-SSG | 0.8896
±0.0013 best reported | best at pub: Str-GCL: Structural Commonsense Driven Graph Contrastive Learning (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 160 | GCA | 0.8894
±0.0015 best reported | best at pub: Barlow Graph Auto-Encoder for Unsupervised Network Embedding (2021) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) |
| 179 | MVGRL | 0.8861
±0.0064 best reported | |
| 210 | DGI | 0.8798
±0.0081 best reported | best at pub: Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learning (2024) |
| 264 | GAE | 0.8666
±0.0007 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) |
| 320 | MLP | 0.8463 | |
| 342 | GMI | 0.8422
±0.0052 best reported | best at pub: Localized Graph Contrastive Learning (2022) |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GrokFormer | 0.9831
±0.0018 | |
| 2 | PolyFormer | 0.9808
±0.0027 | |
| 3 | SGFormer | 0.9796
±0.0081 | |
| 6 | GAT | 0.9782
±0.0028 best reported | best at pub: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) |
| 9 | GCN | 0.9774
±0.0035 best reported | best at pub: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) |
| 17 | SAGE | 0.9739
±0.0018 | |
| 53 | ABGML | 0.9610
±0.0010 | This paper |
| 58 | MLP | 0.9597
±0.0007 | |
| 63 | GCA | 0.9590
±0.0020 best reported | best at pub: Unifying Graph Contrastive Learning with Flexible Contextual Scopes (2022) Difference within reported uncertainty; not counted as underperformance. |
| 69 | BGRL | 0.9580
±0.0040 best reported | best at pub: Unifying Graph Contrastive Learning with Flexible Contextual Scopes (2022) Difference within reported uncertainty; not counted as underperformance. |
| 105 | CORE | 0.9560
±0.0010 | This paper |
| 106 | CCA-SSG | 0.9559
±0.0007 best reported | best at pub: Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning (AAAI 2022) |
| 117 | GraphMAE | 0.9550
±0.0010 | prev best: Rethinking and Simplifying Bootstrapped Graph Latents (2023) Improvement within reported uncertainty; not highlighted. |
| 118 | GraphMAE2 | 0.9550
±0.0020 | prev best: Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition (WWW 2025) Improvement within reported uncertainty; not highlighted. |
| 125 | MVGRL | 0.9544
±0.0027 best reported | best at pub: HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption (2023) Difference within reported uncertainty; not counted as underperformance. |
| 146 | GAE | 0.9520
±0.0010 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 167 | DGI | 0.9489
±0.0009 best reported | best at pub: Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | DoG | 0.9690
±0.0030 | |
| 2 | GWN-fa | 0.9667
±0.0026 | |
| 3 | GWN-sym | 0.9666
±0.0026 | |
| 6 | GraphSAGE | 0.9593
±0.0025 | |
| 12 | GCN | 0.9514
±0.0025 best reported | best at pub: Graph Wave Networks (WWW 2025) |
| 21 | GAT | 0.9437
±0.0028 best reported | best at pub: Graph Wave Networks (WWW 2025) |
| 38 | ABGML | 0.9360
±0.0020 | This paper |
| 43 | DGI | 0.9350
±0.0030 best reported | best at pub: PyG-SSL: A Graph Self-Supervised Learning Toolkit (2024) |
| 48 | CCA-SSG | 0.9337
±0.0020 best reported | best at pub: MA-GCL: Model Augmentation Tricks for Graph Contrastive Learning (AAAI 2022) Difference within reported uncertainty; not counted as underperformance. |
| 51 | GCA | 0.9332
±0.0012 best reported | best at pub: Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminating (AAAI 2022) |
| 53 | BGRL | 0.9331
±0.0013 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) Difference within reported uncertainty; not counted as underperformance. |
| 61 | CORE | 0.9320
±0.0020 | This paper |
| 63 | GraphMAE | 0.9313
±0.0015 best reported | best at pub: Rethinking Graph Contrastive Learning through Relative Similarity Preservation (IJCAI 2025) Difference within reported uncertainty; not counted as underperformance. |
| 66 | GraphMAE2 | 0.9310
±0.0020 | This paper |
| 69 | GRACE | 0.9301
±0.0003 best reported | best at pub: A Fused Gromov-Wasserstein Approach to Subgraph Contrastive Learning (TMLR 2025) |
| 88 | MLP | 0.9280
±0.0020 | |
| 116 | MVGRL | 0.9211
±0.0012 best reported | best at pub: Graph Contrastive Learning with Adaptive Augmentation (WWW 2020) best today: Adaptive Negative Scheduling for Graph Contrastive Learning (2026) Difference within reported uncertainty; not counted as underperformance. |
| 163 | GAE | 0.9005
±0.0035 best reported | best at pub: HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption (2023) Difference within reported uncertainty; not counted as underperformance. |
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 63 | GCN | 0.9220
±0.0440 | |
| 102 | GCMAE | 0.9130
±0.0060 | prev best: Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learning (2023) Improvement within reported uncertainty; not highlighted. |
| 105 | InfoGCL | 0.9120
±0.0130 | This paper |
| 159 | WL | 0.9040
±0.0570 best reported | best at pub: How Powerful are $K$-hop Message Passing Graph Neural Networks (NeurIPS 2022) |
| 186 | GraphMAE2 + CORE | 0.9010
±0.0110 | This paper |
| 199 | MVGRL | 0.8993
±0.0616 best reported | best at pub: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 210 | AUG-MAE | 0.8980
±0.0130 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) Difference within reported uncertainty; not counted as underperformance. |
| 226 | GraphMAE2 | 0.8960
±0.0030 | prev best: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) Improvement within reported uncertainty; not highlighted. |
| 254 | GraphMAE + CORE | 0.8940
±0.0050 | This paper |
| 239 | DiffPool | 0.8940
±0.0460 best reported | best at pub: Graph Classification via Reference Distribution Learning: Theory and Practice (NeurIPS 2024) Difference within reported uncertainty; not counted as underperformance. |
| 257 | InfoGraph | 0.8930
±0.0514 best reported | best at pub: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 258 | GraphMAE | 0.8930
±0.0110 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) Difference within reported uncertainty; not counted as underperformance. |
| 351 | JOAO | 0.8770
±0.0080 best reported | best at pub: Graph Self-Supervised Learning: A Survey (2021) best today: Learning Graph Augmentations to Learn Graph Representations (2022) Difference within reported uncertainty; not counted as underperformance. |
| 354 | GraphCL | 0.8766
±0.0103 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 365 | DGK | 0.8744
±0.0272 best reported | best at pub: Provably Powerful Graph Networks (NeurIPS 2019) best today: Model-Driven Graph Contrastive Learning (2025) Difference within reported uncertainty; not counted as underperformance. |
| 403 | MLP | 0.8660
±0.0495 | |
| 407 | graph2vec | 0.8644
±0.0125 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 best reported | best at pub: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 3 | GCN | 0.9727 | |
| 12 | WL | 0.8590
±0.0010 best reported | best at pub: Propagation Kernels (2014) |
| 67 | CORE (GraphMAE + CORE) | 0.8320
±0.0020 | This paper |
| 104 | GraphCL | 0.8250
±0.0013 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 116 | GraphMAE2 | 0.8230
±0.0090 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) Difference within reported uncertainty; not counted as underperformance. |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 155 | GCMAE | 0.8142
±0.0030 best reported | best at pub: Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learning (2023) Difference within reported uncertainty; not counted as underperformance. |
| 200 | GraphMAE | 0.8042
±0.0035 best reported | best at pub: Self-Supervised Graph Learning via Spectral Bootstrapping and Laplacian-Based Augmentations (2025) Difference within reported uncertainty; not counted as underperformance. |
| 210 | DGK | 0.8031
±0.0046 best reported | best at pub: Graph Capsule Convolutional Neural Networks (ICML 2018) best today: Model-Driven Graph Contrastive Learning (2025) Difference within reported uncertainty; not counted as underperformance. |
| 215 | InfoGCL | 0.8020
±0.0060 | This paper |
| 301 | JOAO | 0.7840
±0.0050 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 338 | InfoGraph | 0.7750
±0.0074 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 406 | graph2vec | 0.7540
±0.0120 best reported | best at pub: InfoGCL: Information-Aware Graph Contrastive Learning (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 9 | CORE (GraphMAE2 + CORE) | 0.8430
±0.0010 | This paper |
| 10 | GraphMAE2 | 0.8410
±0.0030 | prev best: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 22 | GraphMAE | 0.8270
±0.0100 best reported | best at pub: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 23 | GCN | 0.8260
±0.0220 | |
| 30 | GIN | 0.8220
±0.0210 best reported | best at pub: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) Difference within reported uncertainty; not counted as underperformance. |
| 33 | DiffPool | 0.8213
±0.0043 best reported | best at pub: Scalable Graph Compressed Convolutions (2024) Difference within reported uncertainty; not counted as underperformance. |
| 68 | GCMAE | 0.8132
±0.0032 best reported | best at pub: Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learning (2023) Difference within reported uncertainty; not counted as underperformance. |
| 75 | GCC | 0.8110 best reported | best at pub: Graph Self-Supervised Learning: A Survey (2021) |
| 80 | GraphCL | 0.8108
±0.0017 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 103 | AUG-MAE | 0.8050
±0.0050 | prev best: Rethinking Graph Masked Autoencoders through Alignment and Uniformity (AAAI 2024) Improvement within reported uncertainty; not highlighted. |
| 126 | InfoGCL | 0.8001
±0.0132 best reported | best at pub: Self-Supervised Graph Learning via Spectral Bootstrapping and Laplacian-Based Augmentations (2025) Difference within reported uncertainty; not counted as underperformance. |
| 146 | InfoGraph | 0.7940 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) |
| 151 | MLP | 0.7920
±0.0240 | |
| 248 | JOAO | 0.7535
±0.0093 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) |
OGB
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | Jacobi | 0.8968 | |
| 2 | GPR | 0.8953 | |
| 3 | LEMP4HG | 0.8939 | |
| 4 | SAGE | 0.8933 | |
| 30 | GraphMAE | 0.8630
±0.0007 best reported | best at pub: Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Trees (ICML 2024) |
| 125 | GraphMAE2 | 0.8108
±0.0800 best reported | best at pub: Quantizing Text-attributed Graphs for Semantic-Structural Integration (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 152 | CORE | 0.7982 | This paper |
| 351 | MLP | 0.6605
±0.0020 |
