Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks
Abstract
A molecule's 2D representation consists of its atoms, their attributes, and the molecule's covalent bonds. A 3D (geometric) representation of a molecule is called a conformer and consists of its atom types and Cartesian coordinates. Every conformer has a potential energy, and the lower this energy, the more likely it occurs in nature. Most existing machine learning methods for molecular property prediction consider either 2D molecular graphs or 3D conformer structure representations in isolation. Inspired by recent work on using ensembles of conformers in conjunction with 2D graph representations, we propose E(3)-invariant molecular conformer aggregation networks. The method integrates a molecule's 2D representation with that of multiple of its conformers. Contrary to prior work, we propose a novel 2D--3D aggregation mechanism based on a differentiable solver for the Fused Gromov-Wasserstein Barycenter problem and the use of an efficient online conformer generation method based on distance geometry. We show that the proposed aggregation mechanism is E(3) invariant and provides an efficient GPU implementation. Moreover, we demonstrate that the aggregation mechanism helps to outperform state-of-the-art property prediction methods on established datasets significantly.
Benchmark Results
Tested on 2 datasets 4 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
MoleculeNet
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | Graphormer-SPIS | 0.4840
±0.0050 | |
| 2 | Graphormer-SPD | 0.4920
±0.0040 | |
| 3 | conan-FGW | 0.5140
±0.0190 | This paper |
| 7 | GCN | 0.5640
±0.0150 | |
| 10 | AttentiveFP | 0.5780 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 16 | conan | 0.5910
±0.0250 | This paper |
| 27 | D-MPNN | 0.6350
±0.0270 best reported | best at pub: Optimal Transport Graph Neural Networks (2020) |
| 28 | SchNet-emb | 0.6350
±0.0570 | This paper |
| 31 | SchNet-scalar | 0.6720
±0.0270 | This paper |
| 34 | ChemProp3D | 0.6810
±0.0230 | This paper |
| 37 | UniMol | 0.7070 best reported | |
| 61 | Molformer | 0.8480
±0.0130 best reported | best at pub: Atom-Motif Contrastive Transformer for Molecular Property Prediction (2023) Difference within reported uncertainty; not counted as underperformance. |
| 64 | ChemBERTa-2 | 0.8890 | This paper |
| 66 | GROVER_large | 0.8950
±0.0170 | This paper |
| 100 | PretrainGNN | 1.1000
±0.0060 | This paper |
| 146 | 2D-GAT | 2.2880
±0.0170 | This paper |
| # | Model | RMSE ↓ | Paper |
|---|---|---|---|
| 1 | SE(3)-I MPPH | 0.3540
±0.0530 | |
| 2 | ECFP-4 + RF | 0.5600
±0.0660 | |
| 3 | GPSE + GPS | 0.6820 | |
| 12 | D-MPNN | 1.0100
±0.0640 best reported | best at pub: SE(3)-Invariant Multiparameter Persistent Homology for Chiral-Sensitive Molecular Property Prediction (NeurIPS 2023) |
| 13 | AttentiveFP | 1.0340 best reported | best at pub: GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction (AAAI 2021) |
| 24 | conan-FGW | 1.4230
±0.2720 | This paper |
| 26 | UniMol | 1.4800
±0.0480 | This paper |
| 27 | conan | 1.5480
±0.2810 | This paper |
| 29 | SchNet-emb | 1.5870
±0.1360 | This paper |
| 31 | SchNet-scalar | 1.6080
±0.1580 | This paper |
| 49 | ChemProp3D | 2.0140
±0.1820 | This paper |
| 65 | GROVER_large | 2.2720
±0.0510 | This paper |
| 68 | Molformer | 2.3420
±0.0520 | This paper |
| 69 | GIN | 2.3460
±0.1220 | |
| 85 | PretrainGNN | 2.7640
±0.0020 | This paper |
| 127 | 2D-GAT | 8.5640
±1.3450 | This paper |
