Hierarchical Molecular Representation Learning via Fragment-Based Self-Supervised Embedding Prediction
Abstract
Graph self-supervised learning (GSSL) has demonstrated strong potential for generating expressive graph embeddings without the need for human annotations, making it particularly valuable in domains with high labeling costs such as molecular graph analysis. However, existing GSSL methods mostly focus on node- or edge-level information, often ignoring chemically relevant substructures which strongly influence molecular properties. In this work, we propose Graph Semantic Predictive Network (GraSPNet), a hierarchical self-supervised framework that explicitly models both atomic-level and fragment-level semantics. GraSPNet decomposes molecular graphs into chemically meaningful fragments without predefined vocabularies and learns node- and fragment-level representations through multi-level message passing with masked semantic prediction at both levels. This hierarchical semantic supervision enables GraSPNet to learn multi-resolution structural information that is both expressive and transferable. Extensive experiments on multiple molecular property prediction benchmarks demonstrate that GraSPNet learns chemically meaningful representations and consistently outperforms state-of-the-art GSSL methods in transfer learning settings.
Benchmark Results
Tested on 3 datasets 8 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
MoleculeNet
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | Graphormer-SPIS | 0.4840
±0.0050 | |
| 2 | Graphormer-SPD | 0.4920
±0.0040 | |
| 3 | conan-FGW | 0.5140
±0.0190 | |
| 7 | GCN | 0.5640
±0.0150 | |
| 74 | SimSGT | 0.9320
±0.0260 best reported | |
| 79 | GraphCL | 0.9590
±0.0470 best reported | best at pub: 3D Infomax improves GNNs for Molecular Property Prediction (ICML 2021) best today: SE(3)-Invariant Multiparameter Persistent Homology for Chiral-Sensitive Molecular Property Prediction (NeurIPS 2023) Difference within reported uncertainty; not counted as underperformance. |
| 105 | JOAO | 1.1200 best reported | best at pub: 16 Pre-training Molecular Graph Representation with 3D Geometry (ICLR 2021) best today: 3D Molecular Geometry Analysis with 2D Graphs (2023) |
| 109 | GraSPNet | 1.1610
±0.0370 | This paper |
| 113 | MGSSL | 1.1790
±0.0080 best reported | best at pub: Atom-Motif Contrastive Transformer for Molecular Property Prediction (2023) |
| 114 | ContextPred | 1.1960
±0.0370 best reported | best at pub: Improving Molecular Pretraining with Complementary Featurizations (2022) |
| 119 | GROVE | 1.2370
±0.4030 | This paper |
| 140 | GraphFP | 1.9350 best reported | |
| 148 | EdgePred | 2.3680
±0.0700 | This paper |
| 149 | Infomax | 2.9530
±0.0490 | This paper |
| 150 | AttrMasking | 2.9540
±0.0870 | This paper |
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.3540
±0.0530 | |
| 2 | ECFP-4 + RF | 0.5600
±0.0660 | |
| 3 | GPSE + GPS | 0.6820 | |
| 20 | GraSPNet | 1.2320
±0.0500 | This paper |
| 46 | SimSGT | 1.9530
±0.0380 | This paper |
| 69 | GIN | 2.3460
±0.1220 | |
| 75 | GraphFP | 2.5280
±0.0160 | This paper |
| 82 | GROVE | 2.7120
±0.3270 | This paper |
| 90 | MGSSL | 2.8400
±0.1900 best reported | best at pub: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) Difference within reported uncertainty; not counted as underperformance. |
| 96 | Infomax | 3.0330
±0.0260 | This paper |
| 98 | ContextPred | 3.0570
±0.1700 best reported | best at pub: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) Difference within reported uncertainty; not counted as underperformance. |
| 101 | GraphCL | 3.1660
±0.0270 | This paper |
| 102 | EdgePred | 3.1920
±0.0230 | This paper |
| 104 | JOAO | 3.2820
±0.0020 | This paper |
| 114 | AttrMasking | 4.0230
±0.0390 | This paper |
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | MemGNN | 0.5560
±0.0230 | |
| 2 | ProtoS-L2 | 0.5800
±0.0160 | |
| 3 | ProtoW-L2 | 0.6040
±0.0140 | |
| 7 | GCN | 0.6550
±0.0360 | |
| 17 | ContextPred | 0.7020
±0.0200 best reported | best at pub: Improving Molecular Pretraining with Complementary Featurizations (2022) |
| 21 | JOAO | 0.7080 best reported | best at pub: Improving Molecular Pretraining with Complementary Featurizations (2022) best today: 3D Molecular Geometry Analysis with 2D Graphs (2023) |
| 24 | GraphCL | 0.7140
±0.0110 best reported | best at pub: SE(3)-Invariant Multiparameter Persistent Homology for Chiral-Sensitive Molecular Property Prediction (NeurIPS 2023) |
| 47 | SimSGT | 0.7710
±0.0410 best reported | best at pub: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 59 | GraSPNet | 0.8130
±0.0520 | This paper |
| 63 | GROVE | 0.8230
±0.0270 | This paper |
| 73 | MGSSL | 0.8690
±0.0600 best reported | best at pub: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) |
| 87 | Infomax | 0.9700
±0.0230 | This paper |
| 88 | AttrMasking | 0.9820
±0.0520 | This paper |
| 93 | EdgePred | 1.0850
±0.0610 | This paper |
| 102 | GraphFP | 1.3710
±0.0580 | This paper |
