UGMAE: A Unified Framework for Graph Masked Autoencoders
Abstract
Generative self-supervised learning on graphs, particularly graph masked autoencoders, has emerged as a popular learning paradigm and demonstrated its efficacy in handling non-Euclidean data. However, several remaining issues limit the capability of existing methods: 1) the disregard of uneven node significance in masking, 2) the underutilization of holistic graph information, 3) the ignorance of semantic knowledge in the representation space due to the exclusive use of reconstruction loss in the output space, and 4) the unstable reconstructions caused by the large volume of masked contents. In light of this, we propose UGMAE, a unified framework for graph masked autoencoders to address these issues from the perspectives of adaptivity, integrity, complementarity, and consistency. Specifically, we first develop an adaptive feature mask generator to account for the unique significance of nodes and sample informative masks (adaptivity). We then design a ranking-based structure reconstruction objective joint with feature reconstruction to capture holistic graph information and emphasize the topological proximity between neighbors (integrity). After that, we present a bootstrapping-based similarity module to encode the high-level semantic knowledge in the representation space, complementary to the low-level reconstruction in the output space (complementarity). Finally, we build a consistency assurance module to provide reconstruction objectives with extra stabilized consistency targets (consistency). Extensive experiments demonstrate that UGMAE outperforms both contrastive and generative state-of-the-art baselines on several tasks across multiple datasets.
Benchmark Results
Tested on 10 datasets 29 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | GAMLP(JK) | 0.9982
±0.0001 | |
| 2 | GraphCON-GCN | 0.9960 | |
| 3 | GCNII | 0.9953
±0.0001 | |
| 21 | GCN | 0.9850 best reported | best at pub: Graph-Coupled Oscillator Networks (ICML 2022) |
| 57 | GAT | 0.9732
±0.0032 best reported | best at pub: HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption (2023) Difference within reported uncertainty; not counted as underperformance. |
| 92 | GIN | 0.8724
±0.0002 | |
| 111 | UGMAE | 0.7483
±0.0033 | This paper |
| 113 | GraphMAE2 | 0.7451
±0.0036 | This paper |
| 114 | GraphMAE | 0.7450
±0.0029 | This paper |
| 117 | BGRL | 0.7363
±0.0016 | This paper |
| 119 | CCA-SSG | 0.7334
±0.0017 | This paper |
| 126 | GRACE | 0.6971
±0.0017 | This paper |
| 148 | DGI | 0.6380
±0.0020 | This paper |
| 173 | MLP | 0.4620 |
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 63 | GCN | 0.9220
±0.0440 | |
| 105 | InfoGCL | 0.9120
±0.0130 | This paper |
| 159 | WL | 0.9040
±0.0570 best reported | best at pub: How Powerful are $K$-hop Message Passing Graph Neural Networks (NeurIPS 2022) |
| 199 | MVGRL | 0.8993
±0.0616 best reported | best at pub: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 226 | GraphMAE2 | 0.8960
±0.0030 best reported | best today: CORE: Contrastive Masked Feature Reconstruction on Graphs (2025) |
| 239 | DiffPool | 0.8940
±0.0460 best reported | best at pub: Total Variation Graph Neural Networks (ICML 2022) best today: Graph Classification via Reference Distribution Learning: Theory and Practice (NeurIPS 2024) Difference within reported uncertainty; not counted as underperformance. |
| 257 | InfoGraph | 0.8930
±0.0514 best reported | best at pub: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) Difference within reported uncertainty; not counted as underperformance. |
| 258 | GraphMAE | 0.8930
±0.0110 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) Difference within reported uncertainty; not counted as underperformance. |
| 324 | UGMAE | 0.8826
±0.0119 | This paper |
| 351 | JOAO | 0.8770
±0.0080 best reported | best at pub: Graph Self-Supervised Learning: A Survey (2021) best today: Learning Graph Augmentations to Learn Graph Representations (2022) Difference within reported uncertainty; not counted as underperformance. |
| 354 | GraphCL | 0.8766
±0.0103 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 365 | DGK | 0.8744
±0.0272 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 407 | graph2vec | 0.8644
±0.0125 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 best reported | best at pub: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 3 | GCN | 0.9727 | |
| 12 | WL | 0.8590
±0.0010 best reported | best at pub: Propagation Kernels (2014) |
| 104 | GraphCL | 0.8250
±0.0013 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 116 | GraphMAE2 | 0.8230
±0.0090 best reported | best today: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 199 | UGMAE | 0.8046
±0.0017 | This paper |
| 200 | GraphMAE | 0.8042
±0.0035 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Self-Supervised Graph Learning via Spectral Bootstrapping and Laplacian-Based Augmentations (2025) Difference within reported uncertainty; not counted as underperformance. |
| 210 | DGK | 0.8031
±0.0046 | This paper |
| 215 | InfoGCL | 0.8020
±0.0060 | This paper |
| 301 | JOAO | 0.7840
±0.0050 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 338 | InfoGraph | 0.7750
±0.0074 best reported | best at pub: Graph Masked Autoencoders with Transformers (2022) Difference within reported uncertainty; not counted as underperformance. |
| 406 | graph2vec | 0.7540
±0.0120 best reported | best at pub: InfoGCL: Information-Aware Graph Contrastive Learning (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 10 | GraphMAE2 | 0.8410
±0.0030 best reported | best today: CORE: Contrastive Masked Feature Reconstruction on Graphs (2025) |
| 22 | GraphMAE | 0.8270
±0.0100 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Revisiting Graph Autoencoders as Implicit Contrastive Learners (KDD 2024) |
| 23 | GCN | 0.8260
±0.0220 | |
| 30 | GIN | 0.8220
±0.0210 best reported | best at pub: On the Equivalence between Graph Isomorphism Testing and Function Approximation with GNNs (NeurIPS 2019) best today: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) Difference within reported uncertainty; not counted as underperformance. |
| 33 | DiffPool | 0.8213
±0.0043 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) best today: Scalable Graph Compressed Convolutions (2024) Difference within reported uncertainty; not counted as underperformance. |
| 45 | UGMAE | 0.8166
±0.0012 | This paper |
| 75 | GCC | 0.8110 best reported | best at pub: Graph Self-Supervised Learning: A Survey (2021) |
| 80 | GraphCL | 0.8108
±0.0017 best reported | best at pub: Label-invariant Augmentation for Semi-Supervised Graph Classification (NeurIPS 2022) |
| 126 | InfoGCL | 0.8001
±0.0132 best reported | best at pub: InfoGCL: Information-Aware Graph Contrastive Learning (NeurIPS 2021) best today: Self-Supervised Graph Learning via Spectral Bootstrapping and Laplacian-Based Augmentations (2025) Difference within reported uncertainty; not counted as underperformance. |
| 146 | InfoGraph | 0.7940 best reported | best at pub: CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2021) |
| 151 | MLP | 0.7920
±0.0240 | |
| 248 | JOAO | 0.7535
±0.0093 best reported | best at pub: Spectral Augmentation for Self-Supervised Learning on Graphs (ICLR 2022) |
MoleculeNet
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | HIMP | 0.8740
±0.0050 | |
| 2 | GINE w/ VN | 0.8720
±0.0030 | |
| 3 | NaiveGINe+ K=3 w/ VN | 0.8700
±0.0040 | |
| 14 | GCN | 0.8400
±0.0040 | |
| 31 | JOAO | 0.8230
±0.0220 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 37 | Infomax | 0.8160
±0.0210 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 46 | ContextPred | 0.8060
±0.0120 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 47 | GraphCL | 0.8050
±0.0170 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 71 | GraphLoG | 0.7960
±0.0250 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 163 | AttrMasking | 0.7670
±0.0040 | This paper |
| 176 | UGMAE | 0.7630
±0.0030 | This paper |
| 190 | GraphMAE2 | 0.7580
±0.0090 | This paper |
| 202 | GraphMAE | 0.7550
±0.0060 | This paper |
| 255 | No-pretrain | 0.7430
±0.0050 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | ProtoMol | 0.9140
±0.0030 | |
| 2 | MMSG | 0.9080
±0.0050 | |
| 3 | MemGNN | 0.9070 | |
| 43 | GIN | 0.8646
±0.0081 | |
| 67 | UGMAE | 0.8530
±0.0100 | This paper |
| 98 | GraphLoG | 0.8350
±0.0120 | This paper |
| 100 | JOAO | 0.8340
±0.0330 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 105 | GraphMAE | 0.8310
±0.0090 | This paper |
| 151 | GraphMAE2 | 0.8120
±0.0130 | This paper |
| 186 | ContextPred | 0.7960
±0.0120 | This paper |
| 191 | AttrMasking | 0.7930
±0.0160 | This paper |
| 213 | GraphCL | 0.7820
±0.0120 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) |
| 225 | Infomax | 0.7590
±0.0160 | prev best: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) Improvement within reported uncertainty; not highlighted. |
| 231 | No-pretrain | 0.7700
±0.0210 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Dual-perspective Cross Contrastive Learning in Graph Transformers (2024) |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | MAGPrompt+ | 0.9432
±0.0238 | |
| 2 | CamS-LLaMA | 0.9420 | |
| 3 | SE(3)-I MPPH | 0.9400
±0.0210 | |
| 34 | GIN | 0.8875
±0.0049 | |
| 36 | GraphCL | 0.8870
±0.0190 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 39 | JOAO | 0.8790
±0.0200 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 40 | ContextPred | 0.8770
±0.0260 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 54 | GraphLoG | 0.8460
±0.0080 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 55 | Infomax | 0.8400
±0.0260 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 87 | UGMAE | 0.7280
±0.0040 | This paper |
| 101 | GraphMAE | 0.7200
±0.0060 | This paper |
| 116 | GraphMAE2 | 0.7150
±0.0150 | This paper |
| 230 | AttrMasking | 0.6712
±0.0045 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 265 | No-pretrain | 0.6550
±0.0180 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.9930
±0.0040 | |
| 2 | KA-GCN | 0.9920
±0.0050 | |
| 3 | KA-GAT | 0.9910
±0.0050 | |
| 19 | GCN | 0.9130
±0.0170 | |
| 69 | UGMAE | 0.8240
±0.0130 | This paper |
| 71 | GraphMAE | 0.8230
±0.0120 | This paper |
| 79 | JOAO | 0.8132
±0.0249 best reported | best at pub: Graph Self-Contrast Representation Learning (2023) Difference within reported uncertainty; not counted as underperformance. |
| 97 | GraphCL | 0.7890
±0.0420 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: Improving Molecular Pretraining with Complementary Featurizations (2022) Difference within reported uncertainty; not counted as underperformance. |
| 101 | GraphMAE2 | 0.7890
±0.0280 | This paper |
| 103 | GraphLoG | 0.7872
±0.0258 best reported | best at pub: Let Invariant Rationale Discovery Inspire Graph Contrastive Learning (ICML 2022) best today: Graph Self-Contrast Representation Learning (2023) Difference within reported uncertainty; not counted as underperformance. |
| 115 | ContextPred | 0.7720
±0.0088 best reported | |
| 151 | Infomax | 0.7300
±0.0320 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| 162 | AttrMasking | 0.7180
±0.0410 | This paper |
| 205 | No-pretrain | 0.6440
±0.0420 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Dual-perspective Cross Contrastive Learning in Graph Transformers (2024) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | KA-GAT | 0.8470
±0.0020 | |
| 2 | KA-GCN | 0.8420
±0.0010 | |
| 3 | GraphKAN | 0.8370
±0.0010 | |
| 56 | UGMAE | 0.6460
±0.0040 | This paper |
| 66 | GIN | 0.6403
±0.0104 | |
| 68 | JOAO | 0.6400
±0.0100 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 103 | ContextPred | 0.6220
±0.0059 best reported | |
| 114 | GraphCL | 0.6183
±0.0060 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) best today: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 120 | Infomax | 0.6160
±0.0240 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) Difference within reported uncertainty; not counted as underperformance. |
| 123 | GraphLoG | 0.6150
±0.0130 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) Difference within reported uncertainty; not counted as underperformance. |
| 133 | AttrMasking | 0.6121
±0.0065 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 175 | GraphMAE | 0.6030
±0.0110 | This paper |
| 193 | GraphMAE2 | 0.5970
±0.0060 | This paper |
| 213 | No-pretrain | 0.5810
±0.0100 best reported | best today: Dual-perspective Cross Contrastive Learning in Graph Transformers (2024) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | GeomGCL | 0.7630 | |
| 2 | LiGhT DeepGPT | 0.7570
±0.0110 | |
| 3 | CoMPT | 0.7550 | |
| 14 | GCN | 0.7350
±0.0020 | |
| 28 | ContextPred | 0.7140
±0.0180 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 31 | JOAO | 0.7110
±0.0140 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 42 | GraphCL | 0.6960
±0.0230 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 49 | Infomax | 0.6900
±0.0120 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 64 | GraphLoG | 0.6770
±0.0190 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 97 | UGMAE | 0.6560
±0.0030 | This paper |
| 102 | GraphMAE2 | 0.6530
±0.0080 | This paper |
| 126 | AttrMasking | 0.6420
±0.0050 | This paper |
| 128 | GraphMAE | 0.6410
±0.0030 | This paper |
| 152 | No-pretrain | 0.6330
±0.0150 | This paper |
