Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey
Abstract
The precise prediction of molecular properties is essential for advancements in drug development, particularly in virtual screening and compound optimization. The recent introduction of numerous deep learning-based methods has shown remarkable potential in enhancing molecular property prediction (MPP), especially improving accuracy and insights into molecular structures. Yet, two critical questions arise: does the integration of domain knowledge augment the accuracy of molecular property prediction and does employing multi-modal data fusion yield more precise results than unique data source methods? To explore these matters, we comprehensively review and quantitatively analyze recent deep learning methods based on various benchmarks. We discover that integrating molecular information significantly improves molecular property prediction (MPP) for both regression and classification tasks. Specifically, regression improvements, measured by reductions in root mean square error (RMSE), are up to 4.0\ We also discover that enriching 2D graphs with 1D SMILES boosts multi-modal learning performance for regression tasks by up to 9.1\ The two consolidated insights offer crucial guidance for future advancements in drug discovery.
Benchmark Results
Tested on 6 datasets 9 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
MoleculeNet
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | HIMP | 0.8740
±0.0050 | |
| 2 | GINE w/ VN | 0.8720
±0.0030 | |
| 3 | NaiveGINe+ K=3 w/ VN | 0.8700
±0.0040 | |
| 14 | GCN | 0.8400
±0.0040 | |
| 24 | GIN | 0.8290
±0.0069 best reported | |
| 55 | MolLM | 0.8000 | This paper |
| 61 | GraphMVP | 0.7990
±0.0180 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 147 | MolFM | 0.7720 | This paper |
| 157 | MoleculeSTM | 0.7690 | This paper |
| 186 | GIT-Mol | 0.7590 | This paper |
| 195 | MoMu-S | 0.7560 | This paper |
| 196 | MoMu-K | 0.7560 | This paper |
| 303 | KV-PLM | 0.7000 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | ProtoMol | 0.9140
±0.0030 | |
| 2 | MMSG | 0.9080
±0.0050 | |
| 3 | MemGNN | 0.9070 | |
| 43 | GIN | 0.8646
±0.0081 best reported | best at pub: Optimal Transport Graph Neural Networks (2020) |
| 64 | GCN | 0.8540
±0.0110 | |
| 88 | MolLM | 0.8410 | This paper |
| 91 | MolFM | 0.8390 | This paper |
| 132 | MoleculeSTM | 0.8200 | This paper |
| 149 | GraphMVP | 0.8120 | This paper |
| 153 | GIT-Mol | 0.8110 | This paper |
| 211 | KV-PLM | 0.7850 | This paper |
| 230 | MoMu-K | 0.7710 | This paper |
| 236 | MoMu-S | 0.7670 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | MAGPrompt+ | 0.9432
±0.0238 | |
| 2 | CamS-LLaMA | 0.9420 | |
| 3 | SE(3)-I MPPH | 0.9400
±0.0210 | |
| 34 | GIN | 0.8875
±0.0049 best reported | |
| 38 | GCN | 0.8810
±0.0360 | |
| 49 | GraphMVP | 0.8600
±0.0340 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 67 | MolLM | 0.7570 | This paper |
| 74 | GIT-Mol | 0.7390 | This paper |
| 86 | MolFM | 0.7290 | This paper |
| 103 | KV-PLM | 0.7200 | This paper |
| 126 | MoleculeSTM | 0.7080 | This paper |
| 132 | MoMu-S | 0.7050 | This paper |
| 146 | MoMu-K | 0.7010 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.9930
±0.0040 | |
| 2 | KA-GCN | 0.9920
±0.0050 | |
| 3 | KA-GAT | 0.9910
±0.0050 | |
| 14 | MoleculeSTM | 0.9250 | This paper |
| 19 | GCN | 0.9130
±0.0170 | |
| 20 | MolLM | 0.9110 | This paper |
| 30 | KV-PLM | 0.8920 | This paper |
| 34 | GIT-Mol | 0.8830 | This paper |
| 36 | GIN | 0.8810
±0.0250 best reported | best at pub: OOD-GNN: Out-of-Distribution Generalized Graph Neural Network (2021) |
| 49 | GraphMVP | 0.8650
±0.0170 best reported | best at pub: A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretraining (ICML 2023) best today: SubGDiff: A Subgraph Diffusion Model to Improve Molecular Representation Learning (NeurIPS 2024) |
| 91 | MoMu-S | 0.7990 | This paper |
| 94 | MolFM | 0.7970 | This paper |
| 113 | MoMu-K | 0.7740 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | KA-GAT | 0.8470
±0.0020 | |
| 2 | KA-GCN | 0.8420
±0.0010 | |
| 3 | GraphKAN | 0.8370
±0.0010 | |
| 6 | MolLM | 0.7100 | This paper |
| 62 | MolFM | 0.6420 | This paper |
| 66 | GIN | 0.6403
±0.0104 best reported | |
| 70 | GraphMVP | 0.6390 | This paper |
| 75 | MoleculeSTM | 0.6370 | This paper |
| 78 | GIT-Mol | 0.6340 | This paper |
| 125 | GCN | 0.6150
±0.0250 | |
| 164 | MoMu-S | 0.6050 | This paper |
| 172 | MoMu-K | 0.6040 | This paper |
| 189 | KV-PLM | 0.5980 | This paper |
| # | Model | ROC-AUC ↑ | Paper |
|---|---|---|---|
| 1 | GeomGCL | 0.7630 | |
| 2 | LiGhT DeepGPT | 0.7570
±0.0110 | |
| 3 | CoMPT | 0.7550 | |
| 14 | GCN | 0.7350
±0.0020 | |
| 32 | GIN | 0.7095
±0.0027 best reported | best at pub: OOD-GNN: Out-of-Distribution Generalized Graph Neural Network (2021) |
| 50 | GraphMVP | 0.6890
±0.0100 best reported | best at pub: KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction (KDD 2022) |
| 57 | MolLM | 0.6820 | This paper |
| 70 | GIT-Mol | 0.6680 | This paper |
| 105 | MoleculeSTM | 0.6520 | This paper |
| 119 | MolFM | 0.6440 | This paper |
| 144 | MoMu-S | 0.6340 | This paper |
| 164 | MoMu-K | 0.6300 | This paper |
| 210 | KV-PLM | 0.5500 | This paper |
