3D-GSRD: 3D Molecular Graph Auto-Encoder with Selective Re-mask Decoding
Abstract
Masked graph modeling (MGM) is a promising approach for molecular representation learning (MRL). To address these challenges, we propose 3D-GSRD: a 3D Molecular Graph Auto-Encoder with Selective Re-mask Decoding. The core innovation of 3D-GSRD lies in its Selective Re-mask Decoding (SRD), which re-masks only 3D-relevant information from encoder representations while preserving the 2D graph structures. This SRD is synergistically integrated with a 3D Relational-Transformer (3D-ReTrans) encoder alongside a structure-independent decoder. We analyze that SRD, combined with the structure-independent decoder, enhances the encoder's role in MRL. Extensive experiments show that 3D-GSRD achieves strong downstream performance, setting a new state-of-the-art on 7 out of 8 targets in the widely used MD17 molecular property prediction benchmark. The code is released at.
Benchmark Results
Tested on 1 dataset
Tables show presented results in global context (best 3 papers + GCN + MLP).
Quantum Chemistry
| # | Model | MAE ↓ | Paper |
|---|---|---|---|
| 1 | QHNet | 0.0000 | |
| 2 | QHNetV2 | 0.0000 | |
| 3 | PhiSNet | 0.0000 | |
| 27 | 3D-GSRD | 0.0266 | This paper |
| 31 | 3D-EMGP (TorchMD-NET) | 0.0352 | This paper |
| 35 | TorchMD-Net | 0.0390 | prev best: MolSpectra: Pre-training 3D Molecular Representation with Multi-modal Energy Spectra (ICLR 2025) |
| 40 | 3D-ReTrans | 0.0417 | This paper |
| 42 | Frad | 0.0431 |
