ICML 2024

Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks

D. Nguyen, Nina Lukashina, Tai Nguyen, A. T. Le, TrungTin Nguyen, Nhat Ho, Jan Peters, Daniel Sonntag, V. Zaverkin, Mathias Niepert

Main figure for Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks

Abstract

A molecule's 2D representation consists of its atoms, their attributes, and the molecule's covalent bonds. A 3D (geometric) representation of a molecule is called a conformer and consists of its atom types and Cartesian coordinates. Every conformer has a potential energy, and the lower this energy, the more likely it occurs in nature. Most existing machine learning methods for molecular property prediction consider either 2D molecular graphs or 3D conformer structure representations in isolation. Inspired by recent work on using ensembles of conformers in conjunction with 2D graph representations, we propose E(3)-invariant molecular conformer aggregation networks. The method integrates a molecule's 2D representation with that of multiple of its conformers. Contrary to prior work, we propose a novel 2D--3D aggregation mechanism based on a differentiable solver for the Fused Gromov-Wasserstein Barycenter problem and the use of an efficient online conformer generation method based on distance geometry. We show that the proposed aggregation mechanism is E(3) invariant and provides an efficient GPU implementation. Moreover, we demonstrate that the aggregation mechanism helps to outperform state-of-the-art property prediction methods on established datasets significantly.

Benchmark Results

Tested on 2 datasets 4 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

MoleculeNet

#ModelRMSE ↓Paper
1
Graphormer-SPIS
0.4840 ±0.0050
2
Graphormer-SPD
0.4920 ±0.0040
3
conan-FGW
0.5140 ±0.0190
This paper
7
GCN
0.5640 ±0.0150
10
AttentiveFP
actual #10 vs paper #63 53 places worse
0.5780
best reported
actual #10 vs paper #63 53 places worse
paper 0.8770 ±0.0290
paper 0.8770 ±0.0290 Δ at pub 0.2990
16
conan
0.5910 ±0.0250
This paper
27
D-MPNN
actual #27 vs paper #91 64 places worse
0.6350 ±0.0270
best reported
actual #27 vs paper #91 64 places worse
paper 1.0500 ±0.0080
paper 1.0500 ±0.0080 Δ at pub 0.4150
28
SchNet-emb
0.6350 ±0.0570
This paper
31
SchNet-scalar
0.6720 ±0.0270
This paper
34
ChemProp3D
0.6810 ±0.0230
This paper
37
UniMol
actual #37 vs paper #43 6 places worse
0.7070
best reported
actual #37 vs paper #43 6 places worse
paper 0.7880 ±0.0290
61
Molformer
actual #61 vs paper #63 2 places worse
0.8480 ±0.0130
best reported
actual #61 vs paper #63 2 places worse
paper 0.8800 ±0.0280

Difference within reported uncertainty; not counted as underperformance.

paper 0.8800 ±0.0280 Δ at pub 0.0320
64
ChemBERTa-2
0.8890
This paper
66
GROVER_large
0.8950 ±0.0170
This paper
100
PretrainGNN
1.1000 ±0.0060
This paper
146
2D-GAT
2.2880 ±0.0170
This paper
#ModelRMSE ↓Paper
1
SE(3)-I MPPH
0.3540 ±0.0530
2
ECFP-4 + RF
0.5600 ±0.0660
3
GPSE + GPS
0.6820
12
D-MPNN
actual #12 vs paper #54 42 places worse
1.0100 ±0.0640
best reported
actual #12 vs paper #54 42 places worse
paper 2.0820 ±0.0820
13
AttentiveFP
actual #13 vs paper #54 41 places worse
1.0340
best reported
actual #13 vs paper #54 41 places worse
paper 2.0730 ±0.1830
paper 2.0730 ±0.1830 Δ at pub 1.0390
24
conan-FGW
1.4230 ±0.2720
This paper
26
UniMol
1.4800 ±0.0480
This paper
27
conan
1.5480 ±0.2810
This paper
29
SchNet-emb
1.5870 ±0.1360
This paper
31
SchNet-scalar
1.6080 ±0.1580
This paper
49
ChemProp3D
2.0140 ±0.1820
This paper
65
GROVER_large
2.2720 ±0.0510
This paper
68
Molformer
2.3420 ±0.0520
This paper
69
GIN
2.3460 ±0.1220
85
PretrainGNN
2.7640 ±0.0020
This paper
127
2D-GAT
8.5640 ±1.3450
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere