16 Pre-training Molecular Graph Representation with 3D Geometry
Abstract
Molecular graph representation learning is a fundamental problem in modern drug and material discovery. Molecular graphs are typically modeled by their 2D topological structures, but it has been recently discovered that 3D geometric information plays a more vital role in predicting molecular functionalities. However, the lack of 3D information in real-world scenarios has significantly impeded the learning of geometric graph representation. To cope with this challenge, we propose the Graph Multi-View Pre-training (GraphMVP) framework where self-supervised learning (SSL) is performed by leveraging the correspondence and consistency between 2D topological structures and 3D geometric views. GraphMVP effectively learns a 2D molecular graph encoder that is enhanced by richer and more discriminative 3D geometry. We further provide theoretical insights to justify the effectiveness of GraphMVP. Finally, comprehensive experiments show that GraphMVP can consistently outperform existing graph SSL methods. Code is available on GitHub.
Benchmark Results
Tested on 7 datasets 5 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
MoleculeNet
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | HIMP | 0.8740
±0.0050 | |
| 2 | GINE w/ VN | 0.8720
±0.0030 | |
| 3 | NaiveGINe+ K=3 w/ VN | 0.8700
±0.0040 | |
| 14 | GCN | 0.8400
±0.0040 | |
| 31 | JOAO | 0.8230
±0.0220 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 35 | EdgePred | 0.8180
±0.0250 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 46 | ContextPred | 0.8060
±0.0120 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 47 | GraphCL | 0.8050
±0.0170 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 61 | GraphMVP | 0.7990
±0.0180 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 71 | GraphLoG | 0.7960
±0.0250 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 81 | InfoGraph | 0.7930 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 180 | GPT-GNN | 0.7610
±0.0040 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| 184 | GraphMVP-G | 0.7590
±0.0050 | This paper |
| 220 | G-Contextual | 0.7520
±0.0030 | This paper |
| 229 | AttrMask | 0.7510
±0.0090 best reported | best today: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) Difference within reported uncertainty; not counted as underperformance. |
| 236 | -- | 0.7490
±0.0080 | This paper |
| 249 | GraphMVP-C | 0.7440
±0.0020 | This paper |
| 280 | G-Motif | 0.7320
±0.0080 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | ProtoMol | 0.9140
±0.0030 | |
| 2 | MMSG | 0.9080
±0.0050 | |
| 3 | MemGNN | 0.9070 | |
| 43 | GIN | 0.8646
±0.0081 | |
| 98 | GraphLoG | 0.8350
±0.0120 best reported | best today: UGMAE: A Unified Framework for Graph Masked Autoencoders (2024) |
| 100 | JOAO | 0.8340
±0.0330 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 149 | GraphMVP | 0.8120
±0.0090 best reported | best today: Invariant-Based Diagnostics for Graph Benchmarks (2026) |
| 150 | GraphMVP-C | 0.8120
±0.0090 | This paper |
| 176 | EdgePred | 0.7990
±0.0090 best reported | best today: Graph Self-Contrast Representation Learning (2023) |
| 182 | AttrMask | 0.7970
±0.0033 best reported | best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 186 | ContextPred | 0.7960
±0.0120 best reported | best today: Dual-perspective Cross Contrastive Learning in Graph Transformers (2024) Difference within reported uncertainty; not counted as underperformance. |
| 192 | GraphMVP-G | 0.7930
±0.0150 | This paper |
| 196 | G-Contextual | 0.7920
±0.0030 | This paper |
| 204 | InfoGraph | 0.7890
±0.0110 best reported | best today: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 208 | GPT-GNN | 0.7860
±0.0290 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) Difference within reported uncertainty; not counted as underperformance. |
| 213 | GraphCL | 0.7820
±0.0120 best reported | best today: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 259 | G-Motif | 0.7340
±0.0400 | This paper |
| 263 | -- | 0.7260
±0.0490 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | MAGPrompt+ | 0.9432
±0.0238 | |
| 2 | CamS-LLaMA | 0.9420 | |
| 3 | SE(3)-I MPPH | 0.9400
±0.0210 | |
| 34 | GIN | 0.8875
±0.0049 | |
| 36 | GraphCL | 0.8870
±0.0190 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 39 | JOAO | 0.8790
±0.0200 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 40 | ContextPred | 0.8770
±0.0260 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 44 | EdgePred | 0.8730
±0.0160 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 49 | GraphMVP | 0.8600
±0.0340 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 54 | GraphLoG | 0.8460
±0.0080 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 94 | GraphMVP-C | 0.7240
±0.0160 | This paper |
| 124 | GraphMVP-G | 0.7080
±0.0050 | This paper |
| 135 | G-Contextual | 0.7030
±0.0160 | This paper |
| 136 | G-Motif | 0.7030
±0.0150 best reported | best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) Difference within reported uncertainty; not counted as underperformance. |
| 141 | AttrMask | 0.7020
±0.0050 | This paper |
| 173 | InfoGraph | 0.6920
±0.0080 | This paper |
| 220 | GPT-GNN | 0.6750
±0.0130 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) |
| 268 | -- | 0.6540
±0.0240 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.9930
±0.0040 | |
| 2 | KA-GCN | 0.9920
±0.0050 | |
| 3 | KA-GAT | 0.9910
±0.0050 | |
| 19 | GCN | 0.9130
±0.0170 | |
| 40 | AttrMask | 0.8770
±0.0119 best reported | best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 49 | GraphMVP | 0.8650
±0.0170 best reported | best today: SubGDiff: A Subgraph Diffusion Model to Improve Molecular Representation Learning (NeurIPS 2024) |
| 78 | G-Motif | 0.8140
±0.0220 best reported | best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) Difference within reported uncertainty; not counted as underperformance. |
| 79 | JOAO | 0.8132
±0.0249 best reported | best today: Graph Self-Contrast Representation Learning (2023) |
| 96 | GraphMVP-G | 0.7910
±0.0280 | This paper |
| 97 | GraphCL | 0.7890
±0.0420 | This paper |
| 103 | GraphLoG | 0.7872
±0.0258 best reported | best today: Graph Self-Contrast Representation Learning (2023) |
| 106 | InfoGraph | 0.7810 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 111 | GraphMVP-C | 0.7750
±0.0420 | This paper |
| 115 | ContextPred | 0.7370
±0.0400 | |
| 131 | GPT-GNN | 0.7490
±0.0270 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) |
| 191 | G-Contextual | 0.6760
±0.0290 best reported | best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) Difference within reported uncertainty; not counted as underperformance. |
| 192 | EdgePred | 0.5580
±0.0620 | prev best: MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graph (KDD 2021) Improvement within reported uncertainty; not highlighted. |
| 226 | -- | 0.5880
±0.0550 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | KA-GAT | 0.8470
±0.0020 | |
| 2 | KA-GCN | 0.8420
±0.0010 | |
| 3 | GraphKAN | 0.8370
±0.0010 | |
| 66 | GIN | 0.6403
±0.0104 | |
| 68 | JOAO | 0.6400
±0.0100 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 70 | GraphMVP | 0.6390
±0.0120 best reported | best today: A Systematic Survey and Benchmark of Deep Learning for Molecular Property Prediction in the Foundation Model Era (2026) Difference within reported uncertainty; not counted as underperformance. |
| 71 | GraphMVP-C | 0.6390
±0.0120 | This paper |
| 103 | ContextPred | 0.5930
±0.0140 | |
| 114 | GraphCL | 0.6183
±0.0060 best reported | best today: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 123 | GraphLoG | 0.6150
±0.0130 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) Difference within reported uncertainty; not counted as underperformance. |
| 134 | AttrMask | 0.6120
±0.0012 best reported | best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 139 | G-Contextual | 0.6110
±0.0250 best reported | best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) Difference within reported uncertainty; not counted as underperformance. |
| 158 | G-Motif | 0.6060
±0.0110 | This paper |
| 162 | InfoGraph | 0.5920
±0.0020 | prev best: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 170 | EdgePred | 0.5670
±0.0010 | prev best: MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graph (KDD 2021) best today: Community-Invariant Graph Contrastive Learning (ICML 2024) |
| 177 | GraphMVP-G | 0.6020
±0.0110 | This paper |
| 197 | GPT-GNN | 0.5930
±0.0080 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| 214 | -- | 0.5800
±0.0240 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | GeomGCL | 0.7630 | |
| 2 | LiGhT DeepGPT | 0.7570
±0.0110 | |
| 3 | CoMPT | 0.7550 | |
| 14 | GCN | 0.7350
±0.0020 | |
| 28 | ContextPred | 0.7140
±0.0180 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 30 | EdgePred | 0.7120
±0.0110 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 31 | JOAO | 0.7110
±0.0140 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 35 | InfoGraph | 0.7050 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 42 | GraphCL | 0.6960
±0.0230 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 50 | GraphMVP | 0.6890
±0.0100 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 64 | GraphLoG | 0.6770
±0.0190 best reported | best today: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 150 | AttrMask | 0.6330
±0.0060 best reported | best today: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) Difference within reported uncertainty; not counted as underperformance. |
| 151 | GPT-GNN | 0.6330
±0.0030 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 161 | GraphMVP-G | 0.6310
±0.0020 | This paper |
| 162 | GraphMVP-C | 0.6310
±0.0040 | This paper |
| 172 | G-Contextual | 0.6260
±0.0030 | This paper |
| 173 | G-Motif | 0.6260
±0.0050 | This paper |
| 186 | -- | 0.6160
±0.0120 | This paper |
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | Graphormer-SPIS | 0.4840
±0.0050 | |
| 2 | Graphormer-SPD | 0.4920
±0.0040 | |
| 3 | conan-FGW | 0.5140
±0.0190 | |
| 7 | GCN | 0.5640
±0.0150 | |
| 89 | GraphMVP-C | 1.0290 | This paper |
| 92 | GraphMVP-G | 1.0640 | This paper |
| 98 | GraphMVP | 1.0910 | This paper |
| 104 | AM | 1.1120 | This paper |
| 105 | JOAO | 1.1200 | This paper |
| 112 | -- | 1.1780 | This paper |
| 115 | CP | 1.1960 | This paper |
