Improving Molecular Pretraining with Complementary Featurizations
Abstract
-0.5em Molecular pretraining, which learns molecular representations over massive unlabeled data, has become a prominent paradigm to solve a variety of tasks in computational chemistry and drug discovery. Recently, prosperous progress has been made in molecular pretraining with different molecular featurizations, including 1D SMILES strings, 2D graphs, and 3D geometries. However, the role of molecular featurizations with their corresponding neural architectures in molecular pretraining remains largely unexamined. In this paper, through two case studies---chirality classification and aromatic ring counting---we first demonstrate that different featurization techniques convey chemical information differently. In light of this observation, we propose a simple and effective lecular pretraining framework with mplementary featurizations (MOCO). MOCO comprehensively leverages multiple featurizations that complement each other and outperforms existing state-of-the-art models that solely relies on one or two featurizations on a wide range of molecular property prediction tasks.
Benchmark Results
Tested on 8 datasets 29 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
MoleculeNet
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | HIMP | 0.8740
±0.0050 | |
| 2 | GINE w/ VN | 0.8720
±0.0030 | |
| 3 | NaiveGINe+ K=3 w/ VN | 0.8700
±0.0040 | |
| 14 | GCN | 0.8400
±0.0040 | |
| 31 | JOAO | 0.8230
±0.0220 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 46 | ContextPred | 0.8060
±0.0120 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 47 | GraphCL | 0.8050
±0.0170 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 61 | GraphMVP | 0.7990
±0.0180 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 71 | GraphLoG | 0.7960
±0.0250 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 81 | InfoGraph | 0.7930 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 135 | GraphSAGE | 0.7744
±0.0038 best reported | |
| 164 | MOCO | 0.7670
±0.0040 | This paper |
| 180 | GPT-GNN | 0.7610
±0.0040 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) |
| 185 | --- | 0.7590
±0.0030 | This paper |
| 202 | GraphMAE | 0.7550
±0.0060 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 222 | GROVER-C | 0.7520
±0.0030 | This paper |
| 229 | AttrMask | 0.7510
±0.0090 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) Difference within reported uncertainty; not counted as underperformance. |
| 281 | GROVER-M | 0.7320
±0.0080 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | ProtoMol | 0.9140
±0.0030 | |
| 2 | MMSG | 0.9080
±0.0050 | |
| 3 | MemGNN | 0.9070 | |
| 43 | GIN | 0.8646
±0.0081 | |
| 82 | GraphSAGE | 0.8451 best reported | |
| 98 | GraphLoG | 0.8350
±0.0120 best reported | best at pub: Let Invariant Rationale Discovery Inspire Graph Contrastive Learning (ICML 2022) best today: UGMAE: A Unified Framework for Graph Masked Autoencoders (2024) |
| 100 | JOAO | 0.8340
±0.0330 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 105 | GraphMAE | 0.8310
±0.0090 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 117 | MOCO | 0.8260
±0.0030 | This paper |
| 149 | GraphMVP | 0.8120
±0.0090 best reported | best at pub: Unified 2D and 3D Pre-Training of Molecular Representations (KDD 2022) best today: Invariant-Based Diagnostics for Graph Benchmarks (2026) |
| 182 | AttrMask | 0.7970
±0.0033 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) |
| 186 | ContextPred | 0.7960
±0.0120 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: Dual-perspective Cross Contrastive Learning in Graph Transformers (2024) Difference within reported uncertainty; not counted as underperformance. |
| 197 | GROVER-C | 0.7920
±0.0030 | This paper |
| 204 | InfoGraph | 0.7890
±0.0110 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) |
| 208 | GPT-GNN | 0.7860
±0.0290 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) Difference within reported uncertainty; not counted as underperformance. |
| 213 | GraphCL | 0.7820
±0.0120 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 260 | GROVER-M | 0.7340
±0.0400 | This paper |
| 271 | --- | 0.7150
±0.0270 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | MAGPrompt+ | 0.9432
±0.0238 | |
| 2 | CamS-LLaMA | 0.9420 | |
| 3 | SE(3)-I MPPH | 0.9400
±0.0210 | |
| 34 | GIN | 0.8875
±0.0049 | |
| 36 | GraphCL | 0.8870
±0.0190 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 39 | JOAO | 0.8790
±0.0200 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 40 | ContextPred | 0.8770
±0.0260 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 49 | GraphMVP | 0.8600
±0.0340 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 54 | GraphLoG | 0.8460
±0.0080 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 57 | GraphSAGE | 0.8304
±0.0038 best reported | |
| 101 | GraphMAE | 0.7200
±0.0060 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 112 | MOCO | 0.7160
±0.0100 | This paper |
| 122 | --- | 0.7100
±0.0050 | This paper |
| 138 | GROVER-C | 0.7030
±0.0160 | This paper |
| 141 | AttrMask | 0.7020
±0.0050 | This paper |
| 173 | InfoGraph | 0.6920
±0.0080 | This paper |
| 220 | GPT-GNN | 0.6750
±0.0130 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) |
| 246 | GROVER-M | 0.6640
±0.0340 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.9930
±0.0040 | |
| 2 | KA-GCN | 0.9920
±0.0050 | |
| 3 | KA-GAT | 0.9910
±0.0050 | |
| 19 | GCN | 0.9130
±0.0170 | |
| 40 | AttrMask | 0.8770
±0.0119 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) |
| 49 | GraphMVP | 0.8650
±0.0170 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: SubGDiff: A Subgraph Diffusion Model to Improve Molecular Representation Learning (NeurIPS 2024) |
| 71 | GraphMAE | 0.8230
±0.0120 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 77 | MOCO | 0.8160
±0.0370 | This paper |
| 79 | JOAO | 0.8132
±0.0249 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: Graph Self-Contrast Representation Learning (2023) |
| 97 | GraphCL | 0.7890
±0.0420 | This paper |
| 103 | GraphLoG | 0.7872
±0.0258 best reported | best at pub: Let Invariant Rationale Discovery Inspire Graph Contrastive Learning (ICML 2022) best today: Graph Self-Contrast Representation Learning (2023) |
| 106 | InfoGraph | 0.7810 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 107 | GROVER-M | 0.7780
±0.0200 | This paper |
| 115 | ContextPred | 0.7720
±0.0088 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 131 | GPT-GNN | 0.7490
±0.0270 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) |
| 165 | --- | 0.7150
±0.0530 | This paper |
| 223 | GROVER-C | 0.5990
±0.0820 | This paper |
| 238 | GraphSAGE | 0.5580
±0.0620 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | KA-GAT | 0.8470
±0.0020 | |
| 2 | KA-GCN | 0.8420
±0.0010 | |
| 3 | GraphKAN | 0.8370
±0.0010 | |
| 66 | GIN | 0.6403
±0.0104 | |
| 68 | JOAO | 0.6400
±0.0100 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 70 | GraphMVP | 0.6390
±0.0120 best reported | best at pub: Unified 2D and 3D Pre-Training of Molecular Representations (KDD 2022) best today: A Systematic Survey and Benchmark of Deep Learning for Molecular Property Prediction in the Foundation Model Era (2026) Difference within reported uncertainty; not counted as underperformance. |
| 103 | ContextPred | 0.6220
±0.0059 best reported | |
| 114 | GraphCL | 0.6183
±0.0060 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) best today: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 123 | GraphLoG | 0.6150
±0.0130 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 136 | MOCO | 0.6120
±0.0060 | This paper |
| 134 | AttrMask | 0.6120
±0.0012 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 160 | GROVER-M | 0.6060
±0.0110 | This paper |
| 162 | InfoGraph | 0.6054
±0.0090 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) best today: Community-Invariant Graph Contrastive Learning (ICML 2024) Difference within reported uncertainty; not counted as underperformance. |
| 175 | GraphMAE | 0.6030
±0.0110 best reported | best at pub: GraphMAE: Self-Supervised Masked Graph Autoencoders (KDD 2022) best today: A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery (2025) Difference within reported uncertainty; not counted as underperformance. |
| 197 | GPT-GNN | 0.5930
±0.0080 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) Difference within reported uncertainty; not counted as underperformance. |
| 207 | GROVER-C | 0.5840
±0.0060 | This paper |
| 218 | --- | 0.5770
±0.0310 | This paper |
| 227 | GraphSAGE | 0.5670
±0.0010 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | GeomGCL | 0.7630 | |
| 2 | LiGhT DeepGPT | 0.7570
±0.0110 | |
| 3 | CoMPT | 0.7550 | |
| 14 | GCN | 0.7350
±0.0020 | |
| 28 | ContextPred | 0.7140
±0.0180 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 31 | JOAO | 0.7110
±0.0140 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 35 | InfoGraph | 0.7050 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 42 | GraphCL | 0.6960
±0.0230 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 50 | GraphMVP | 0.6890
±0.0100 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 62 | GraphSAGE | 0.6775
±0.0041 best reported | |
| 64 | GraphLoG | 0.6770
±0.0190 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 110 | MOCO | 0.6490
±0.0080 | This paper |
| 113 | --- | 0.6470
±0.0230 | This paper |
| 128 | GraphMAE | 0.6410
±0.0010 | This paper |
| 150 | AttrMask | 0.6330
±0.0060 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) Difference within reported uncertainty; not counted as underperformance. |
| 151 | GPT-GNN | 0.6330
±0.0030 best reported | best at pub: Motif-based Graph Self-Supervised Learning for Molecular Property Prediction (NeurIPS 2021) best today: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks (ICLR 2024) |
| 174 | GROVER-C | 0.6260
±0.0030 | This paper |
| 175 | GROVER-M | 0.6260
±0.0050 | This paper |
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | Graphormer-SPIS | 0.4840
±0.0050 | |
| 2 | Graphormer-SPD | 0.4920
±0.0040 | |
| 3 | conan-FGW | 0.5140
±0.0190 | |
| 7 | GCN | 0.5640
±0.0150 | |
| 83 | MOCO | 0.9840
±0.0340 | This paper |
| 98 | GraphMVP | 1.0910
±0.0210 | This paper |
| 103 | AttrMask | 1.1120
±0.0480 | This paper |
| 105 | JOAO | 1.1200
±0.0190 | This paper |
| 114 | ContextPred | 1.1960
±0.0370 | This paper |
| 123 | --- | 1.3640
±0.0160 | This paper |
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | MemGNN | 0.5560
±0.0230 | |
| 2 | ProtoS-L2 | 0.5800
±0.0160 | |
| 3 | ProtoW-L2 | 0.6040
±0.0140 | |
| 7 | GCN | 0.6550
±0.0360 | |
| 17 | ContextPred | 0.7020
±0.0200 | This paper |
| 20 | MOCO | 0.7070
±0.0010 | This paper |
| 21 | JOAO | 0.7080
±0.0070 | This paper |
| 27 | GraphMVP | 0.7180
±0.0160 | This paper |
| 31 | AttrMask | 0.7300
±0.0040 | This paper |
| 37 | --- | 0.7360
±0.0060 | This paper |
