Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey

Taojie Kuang, Pengfei Liu, Zhixiang Ren

Main figure for Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey

Abstract

The precise prediction of molecular properties is essential for advancements in drug development, particularly in virtual screening and compound optimization. The recent introduction of numerous deep learning-based methods has shown remarkable potential in enhancing molecular property prediction (MPP), especially improving accuracy and insights into molecular structures. Yet, two critical questions arise: does the integration of domain knowledge augment the accuracy of molecular property prediction and does employing multi-modal data fusion yield more precise results than unique data source methods? To explore these matters, we comprehensively review and quantitatively analyze recent deep learning methods based on various benchmarks. We discover that integrating molecular information significantly improves molecular property prediction (MPP) for both regression and classification tasks. Specifically, regression improvements, measured by reductions in root mean square error (RMSE), are up to 4.0\ We also discover that enriching 2D graphs with 1D SMILES boosts multi-modal learning performance for regression tasks by up to 9.1\ The two consolidated insights offer crucial guidance for future advancements in drug discovery.

Benchmark Results

Tested on 6 datasets 9 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

MoleculeNet

#ModelROC-AUC ↑Paper
1
HIMP
0.8740 ±0.0050
2
GINE w/ VN
0.8720 ±0.0030
3
NaiveGINe+ K=3 w/ VN
0.8700 ±0.0040
14
GCN
0.8400 ±0.0040
24
GIN
actual #24 vs paper #235 211 places worse
0.8290 ±0.0069
best reported
actual #24 vs paper #235 211 places worse
paper 0.7490
55
MolLM
0.8000
This paper
61
GraphMVP
actual #61 vs paper #246 185 places worse
0.7990 ±0.0180
best reported
actual #61 vs paper #246 185 places worse
paper 0.7450
147
MolFM
0.7720
This paper
157
MoleculeSTM
0.7690
This paper
186
GIT-Mol
0.7590
This paper
195
MoMu-S
0.7560
This paper
196
MoMu-K
0.7560
This paper
303
KV-PLM
0.7000
This paper
#ModelROC-AUC ↑Paper
1
ProtoMol
0.9140 ±0.0030
2
MMSG
0.9080 ±0.0050
3
MemGNN
0.9070
43
GIN
actual #43 vs paper #262 219 places worse
0.8646 ±0.0081
best reported
actual #43 vs paper #262 219 places worse
paper 0.7260
64
GCN
0.8540 ±0.0110
88
MolLM
0.8410
This paper
91
MolFM
0.8390
This paper
132
MoleculeSTM
0.8200
This paper
149
GraphMVP
0.8120
This paper
153
GIT-Mol
0.8110
This paper
211
KV-PLM
0.7850
This paper
230
MoMu-K
0.7710
This paper
236
MoMu-S
0.7670
This paper
#ModelROC-AUC ↑Paper
1
MAGPrompt+
0.9432 ±0.0238
2
CamS-LLaMA
0.9420
3
SE(3)-I MPPH
0.9400 ±0.0210
34
GIN
actual #34 vs paper #267 233 places worse
0.8875 ±0.0049
best reported
actual #34 vs paper #267 233 places worse
paper 0.6540
38
GCN
0.8810 ±0.0360
49
GraphMVP
actual #49 vs paper #92 43 places worse
0.8600 ±0.0340
best reported
actual #49 vs paper #92 43 places worse
paper 0.7240
67
MolLM
0.7570
This paper
74
GIT-Mol
0.7390
This paper
86
MolFM
0.7290
This paper
103
KV-PLM
0.7200
This paper
126
MoleculeSTM
0.7080
This paper
132
MoMu-S
0.7050
This paper
146
MoMu-K
0.7010
This paper
#ModelROC-AUC ↑Paper
1
SE(3)-I MPPH
0.9930 ±0.0040
2
KA-GCN
0.9920 ±0.0050
3
KA-GAT
0.9910 ±0.0050
14
MoleculeSTM
0.9250
This paper
19
GCN
0.9130 ±0.0170
20
MolLM
0.9110
This paper
30
KV-PLM
0.8920
This paper
34
GIT-Mol
0.8830
This paper
36
GIN
actual #36 vs paper #225 189 places worse
0.8810 ±0.0250
best reported
actual #36 vs paper #225 189 places worse
paper 0.5880
paper 0.5880 Δ at pub 0.2930
49
GraphMVP
actual #49 vs paper #96 47 places worse
0.8650 ±0.0170
best reported
actual #49 vs paper #96 47 places worse
paper 0.7900
91
MoMu-S
0.7990
This paper
94
MolFM
0.7970
This paper
113
MoMu-K
0.7740
This paper
#ModelROC-AUC ↑Paper
1
KA-GAT
0.8470 ±0.0020
2
KA-GCN
0.8420 ±0.0010
3
GraphKAN
0.8370 ±0.0010
6
MolLM
0.7100
This paper
62
MolFM
0.6420
This paper
66
GIN
actual #66 vs paper #213 147 places worse
0.6403 ±0.0104
best reported
actual #66 vs paper #213 147 places worse
paper 0.5800
70
GraphMVP
0.6390
This paper
75
MoleculeSTM
0.6370
This paper
78
GIT-Mol
0.6340
This paper
125
GCN
0.6150 ±0.0250
164
MoMu-S
0.6050
This paper
172
MoMu-K
0.6040
This paper
189
KV-PLM
0.5980
This paper
#ModelROC-AUC ↑Paper
1
GeomGCL
0.7630
2
LiGhT DeepGPT
0.7570 ±0.0110
3
CoMPT
0.7550
14
GCN
0.7350 ±0.0020
32
GIN
actual #32 vs paper #185 153 places worse
0.7095 ±0.0027
best reported
actual #32 vs paper #185 153 places worse
paper 0.6160
50
GraphMVP
actual #50 vs paper #159 109 places worse
0.6890 ±0.0100
best reported
actual #50 vs paper #159 109 places worse
paper 0.6310
57
MolLM
0.6820
This paper
70
GIT-Mol
0.6680
This paper
105
MoleculeSTM
0.6520
This paper
119
MolFM
0.6440
This paper
144
MoMu-S
0.6340
This paper
164
MoMu-K
0.6300
This paper
210
KV-PLM
0.5500
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere