E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials

Simon L. Batzner, Albert Musaelian, Lixin Sun, M. Geiger, J. Mailoa, M. Kornbluth, Nicola Molinari, T. Smidt, B. Kozinsky

Main figure for E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials

Abstract

This work presents Neural Equivariant Interatomic Potentials (NequIP), an E(3)-equivariant neural network approach for learning interatomic potentials from ab-initio calculations for molecular dynamics simulations. While most contemporary symmetry-aware models use invariant convolutions and only act on scalars, NequIP employs E(3)-equivariant convolutions for interactions of geometric tensors, resulting in a more information-rich and faithful representation of atomic environments. The method achieves state-of-the-art accuracy on a challenging and diverse set of molecules and materials while exhibiting remarkable data efficiency. NequIP outperforms existing models with up to three orders of magnitude fewer training data, challenging the widely held belief that deep neural networks require massive training sets. The high data efficiency of the method allows for the construction of accurate potentials using high-order quantum chemical level of theory as reference and enables high-fidelity molecular dynamics simulations over long time scales.

Proposed method: NequIP (l=3)

Benchmark Results

Tested on 1 dataset 3 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Quantum Chemistry

#ModelMAE ↓Paper
1
QHNet
0.0000
2
QHNetV2
0.0000
3
PhiSNet
0.0000
22
PaiNN
actual #22 vs paper #119 97 places worse
0.0100
best reported
actual #22 vs paper #119 97 places worse
paper 2.7000
34
NequIP
actual #34 vs paper #118 84 places worse
0.0390
best reported
actual #34 vs paper #118 84 places worse
paper 2.2000
46
SchNet
actual #46 vs paper #119 73 places worse
0.0500
best reported
actual #46 vs paper #119 73 places worse
paper 3.5000
51
SpookyNet
actual #51 vs paper #118 67 places worse
0.0520
best reported
actual #51 vs paper #118 67 places worse
paper 2.3000
61
sGDML
actual #61 vs paper #119 58 places worse
0.0600
best reported
actual #61 vs paper #119 58 places worse
paper 3.0000
paper 3.0000 Δ at pub 2.9400
63
NewtonNet
actual #63 vs paper #119 56 places worse
0.0610
best reported
actual #63 vs paper #119 56 places worse
paper 2.6000
64
DimeNet++
actual #64 vs paper #119 55 places worse
0.0640
best reported
actual #64 vs paper #119 55 places worse
paper 2.8000
paper 2.8000 Δ at pub 2.7360 Δ today 2.7360
SOTA performance (not significantly different from the best) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere