SE3Set: Harnessing equivariant hypergraph neural networks for molecular representation learning
Abstract
In this paper, we develop SE3Set, an SE(3) equivariant hypergraph neural network architecture tailored for advanced molecular representation learning. Hypergraphs are not merely an extension of traditional graphs; they are pivotal for modeling high-order relationships, a capability that conventional equivariant graph-based methods lack due to their inherent limitations in representing intricate many-body interactions. To achieve this, we first construct hypergraphs via proposing a new fragmentation method that considers both chemical and three-dimensional spatial information of molecular system. We then design SE3Set, which incorporates equivariance into the hypergragh neural network. This ensures that the learned molecular representations are invariant to spatial transformations, thereby providing robustness essential for accurate prediction of molecular properties. SE3Set has shown performance on par with state-of-the-art (SOTA) models for small molecule datasets like QM9 and MD17. It excels on the MD22 dataset, achieving a notable improvement of approximately 20\
Benchmark Results
Tested on 1 dataset 4 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Quantum Chemistry
| # | Model | MAE ↓ | Paper |
|---|---|---|---|
| 1 | QHNet | 0.0000 | |
| 2 | QHNetV2 | 0.0000 | |
| 3 | PhiSNet | 0.0000 | |
| 6 | ViSNet | 0.0007 best reported | |
| 22 | PaiNN | 0.0100 best reported | best at pub: Symmetry-Informed Geometric Representation for Molecules, Proteins, and Crystalline Materials (NeurIPS 2023) |
| 26 | Equiformer | 0.0200 best reported | best at pub: Symmetry-Informed Geometric Representation for Molecules, Proteins, and Crystalline Materials (NeurIPS 2023) |
| 37 | SE3Set | 0.0390 | This paper |
| 34 | NequIP | 0.0390 | |
| 36 | QuinNet | 0.0390 | This paper |
| 46 | SchNet | 0.0500 best reported | |
| 47 | GemNet | 0.0502 best reported | best at pub: On the Completeness of Invariant Geometric Deep Learning Models (ICLR 2024) |
| 54 | ET | 0.0520 | This paper |
| 64 | DimeNet++ | 0.0640 | This paper |
