TMLR 2024

SE3Set: Harnessing equivariant hypergraph neural networks for molecular representation learning

Hongfei Wu, Lijun Wu, Guoqing Liu, Zhirong Liu, Bin Shao, Zun Wang

Main figure for SE3Set: Harnessing equivariant hypergraph neural networks for molecular representation learning

Abstract

In this paper, we develop SE3Set, an SE(3) equivariant hypergraph neural network architecture tailored for advanced molecular representation learning. Hypergraphs are not merely an extension of traditional graphs; they are pivotal for modeling high-order relationships, a capability that conventional equivariant graph-based methods lack due to their inherent limitations in representing intricate many-body interactions. To achieve this, we first construct hypergraphs via proposing a new fragmentation method that considers both chemical and three-dimensional spatial information of molecular system. We then design SE3Set, which incorporates equivariance into the hypergragh neural network. This ensures that the learned molecular representations are invariant to spatial transformations, thereby providing robustness essential for accurate prediction of molecular properties. SE3Set has shown performance on par with state-of-the-art (SOTA) models for small molecule datasets like QM9 and MD17. It excels on the MD22 dataset, achieving a notable improvement of approximately 20\

Proposed method: SE3Set

Benchmark Results

Tested on 1 dataset 4 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Quantum Chemistry

#ModelMAE ↓Paper
1
QHNet
0.0000
2
QHNetV2
0.0000
3
PhiSNet
0.0000
6
ViSNet
actual #6 vs paper #33 27 places worse
0.0007
best reported
22
PaiNN
actual #22 vs paper #63 41 places worse
0.0100
best reported
actual #22 vs paper #63 41 places worse
paper 0.0640
26
Equiformer
actual #26 vs paper #42 16 places worse
0.0200
best reported
actual #26 vs paper #42 16 places worse
paper 0.0460
37
SE3Set
0.0390
This paper
34
NequIP
actual #34 vs paper #34
0.0390
actual #34 vs paper #34
paper 0.0390
36
QuinNet
0.0390
This paper
46
SchNet
actual #46 vs paper #67 21 places worse
0.0500
best reported
actual #46 vs paper #67 21 places worse
paper 0.0800
47
GemNet
actual #47 vs paper #48 1 place worse
0.0502
best reported
actual #47 vs paper #48 1 place worse
paper 0.0510
paper 0.0510 Δ at pub 0.0008
54
ET
0.0520
This paper
64
DimeNet++
0.0640
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere