3D-GSRD: 3D Molecular Graph Auto-Encoder with Selective Re-mask Decoding

Chang Wu, Zhiyuan Liu, Wen Shu, Liang Wang, Yanchen Luo, Wenqiang Lei, Yatao Bian, Junfeng Fang, Xiang Wang

Main figure for 3D-GSRD: 3D Molecular Graph Auto-Encoder with Selective Re-mask Decoding

Abstract

Masked graph modeling (MGM) is a promising approach for molecular representation learning (MRL). To address these challenges, we propose 3D-GSRD: a 3D Molecular Graph Auto-Encoder with Selective Re-mask Decoding. The core innovation of 3D-GSRD lies in its Selective Re-mask Decoding (SRD), which re-masks only 3D-relevant information from encoder representations while preserving the 2D graph structures. This SRD is synergistically integrated with a 3D Relational-Transformer (3D-ReTrans) encoder alongside a structure-independent decoder. We analyze that SRD, combined with the structure-independent decoder, enhances the encoder's role in MRL. Extensive experiments show that 3D-GSRD achieves strong downstream performance, setting a new state-of-the-art on 7 out of 8 targets in the widely used MD17 molecular property prediction benchmark. The code is released at.

Proposed method: 3D-GSRD

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Quantum Chemistry

#ModelMAE ↓Paper
1
QHNet
0.0000
2
QHNetV2
0.0000
3
PhiSNet
0.0000
27
3D-GSRD
0.0266
This paper
31
3D-EMGP (TorchMD-NET)
0.0352
This paper
35
TorchMD-Net
actual #35 vs paper #35
0.0390
actual #35 vs paper #35
paper 0.0390
40
3D-ReTrans
0.0417
This paper
42
Frad
actual #42 vs paper #42
0.0431
actual #42 vs paper #42
paper 0.0431
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported value improved over the best known when published