ProtoMol: Enhancing Molecular Property Prediction via Prototype-Guided Multimodal Learning
Abstract
Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity, bioactivity, and physicochemical properties through the integration of structural and semantic information. However, existing multimodal methods suffer from two key limitations: (1) they typically perform cross-modal interaction only at the final encoder layer, thus overlooking hierarchical semantic dependencies; (2) they lack a unified prototype space for robust alignment between modalities. To address these limitations, we propose ProtoMol, a prototype-guided multimodal framework that enables fine-grained integration and consistent semantic alignment between molecular graphs and textual descriptions. ProtoMol incorporates dual-branch hierarchical encoders, utilizing Graph Neural Networks to process structured molecular graphs and Transformers to encode unstructured texts, resulting in comprehensive layer-wise representations. Then, ProtoMol introduces a layer-wise bidirectional cross-modal attention mechanism that progressively aligns semantic features across layers. Furthermore, a shared prototype space with learnable, class-specific anchors is constructed to guide both modalities toward coherent and discriminative representations. Extensive experiments on multiple benchmark datasets demonstrate that ProtoMol consistently outperforms state-of-the-art baselines across a variety of molecular property prediction tasks.
Benchmark Results
Tested on 1 dataset 3 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
MoleculeNet
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | ProtoMol | 0.9140
±0.0030 | This paper |
| 2 | MMSG | 0.9080
±0.0050 | This paper |
| 3 | MemGNN | 0.9070 | |
| 4 | Tri_SGD | 0.9030
±0.0100 | This paper |
| 42 | S-CGIB | 0.8650
±0.0080 | prev best: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Improvement within reported uncertainty; not highlighted. |
| 43 | GIN | 0.8646
±0.0081 | |
| 44 | MDFCL | 0.8640
±0.0100 | This paper |
| 61 | Uni-Mol | 0.8570
±0.0020 | prev best: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) |
| 82 | GraphSAGE | 0.8451 best reported | |
| 98 | GraphLoG | 0.8350
±0.0120 best reported | best at pub: Motif-aware Attribute Masking for Molecular Graph Pre-training (2023) best today: UGMAE: A Unified Framework for Graph Masked Autoencoders (2024) |
| 102 | SMILES-BERT | 0.8330
±0.0330 | This paper |
| 130 | MGSSL | 0.8203
±0.0379 best reported | best at pub: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 134 | MICRO-Graph | 0.8190
±0.0040 best reported | best at pub: Motif-based Graph Representation Learning with Application to Chemical Molecules (2022) |
| 145 | SMILES2vec | 0.8140
±0.0360 | This paper |
| 147 | MoAMa | 0.8132
±0.0106 best reported | best at pub: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 152 | GROVE | 0.8113
±0.0014 best reported | best at pub: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 172 | GraphFP | 0.8030
±0.0310 | prev best: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Improvement within reported uncertainty; not highlighted. |
| 180 | SimSGT | 0.7980
±0.0130 | prev best: Pre-training Graph Neural Networks on Molecules by Using Subgraph-Conditioned Graph Information Bottleneck (AAAI 2024) Improvement within reported uncertainty; not highlighted. |
| 213 | GraphCL | 0.7820
±0.0120 best reported | best at pub: Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 224 | DGI | 0.7780
±0.0050 | prev best: Graph Self-Contrast Representation Learning (2023) Improvement within reported uncertainty; not highlighted. |
| 243 | GraphPT | 0.7600
±0.0050 | This paper |
| 248 | JOAOv2 | 0.7549
±0.0127 best reported | best at pub: Graph Self-Contrast Representation Learning (2023) Difference within reported uncertainty; not counted as underperformance. |
