ICLR 2023

Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channel

Xuan Li, Zhanke Zhou, Jiangchao Yao, Yu Rong, Lu Zhang, Bo Han

Main figure for Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channel

Abstract

Graph Neural Networks (GNNs) have been widely adopted for drug discovery with molecular graphs. Nevertheless, current GNNs mainly excel in leveraging short-range interactions (SRI) but struggle to capture long-range interactions (LRI), both of which are crucial for determining molecular properties. To tackle this issue, we propose a method to abstract the collective information of atomic groups into a few Neural Atoms by implicitly projecting the atoms of a molecular. Specifically, we explicitly exchange the information among neural atoms and project them back to the atoms’ representations as an enhancement. With this mechanism, neural atoms establish the communication channels among distant nodes, effectively reducing the interaction scope of arbitrary node pairs into a single hop. To provide an inspection of our method from a physical perspective, we reveal its connection to the traditional LRI calculation method, Ewald Summation. The Neural Atom can enhance GNNs to capture LRI by approximating the potential LRI of the molecular. We conduct extensive experiments on four long-range graph benchmarks, covering graph-level and link-level tasks on molecular graphs. We achieve up to a 27.32\ Empirically, our method can be equipped with an arbitrary GNN to help capture LRI. Code and datasets are publicly available in.

Benchmark Results

Tested on 1 dataset 1 baseline value reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

LRGB

#ModelMRR ↑Paper
1
FloydNet
0.6143
2
Exphormer
0.4737 ±0.0024
3
Exphormer + LapPE
0.4737 ±0.0024
8
GatedGCN
actual #8 vs paper #77 69 places worse
0.4670 ±0.0004
best reported
actual #8 vs paper #77 69 places worse
paper 0.3218 ±0.0011
paper 0.3218 ±0.0011 Δ today 0.1452
15
GINE
actual #15 vs paper #78 63 places worse
0.4617 ±0.0005
best reported
actual #15 vs paper #78 63 places worse
paper 0.3180 ±0.0027
paper 0.3180 ±0.0027 Δ today 0.1437
16
GIN
0.4617 ±0.0005
28
GCN
actual #28 vs paper #88 60 places worse
0.4526 ±0.0006
best reported
actual #28 vs paper #88 60 places worse
paper 0.2329 ±0.0009
paper 0.2329 ±0.0009 Δ at pub 0.0905 Δ today 0.2197
61
SAN+LapPE
0.3350 ±0.0003
This paper
64
GraphGPS
0.3337 ±0.0006
This paper
72
GatedGCN + Neural Atoms
0.3258 ±0.0003
This paper
75
GatedGCN+RWSE
0.3242 ±0.0008
This paper
80
Transformer+LapPE
0.3174 ±0.0020
This paper
82
GCNII
0.3161 ±0.0004
This paper
83
GINE + Neural Atoms
0.3126 ±0.0021
This paper
85
GCNII + Neural Atoms
0.3049 ±0.0006
This paper
88
GCN + Neural Atoms
0.2534 ±0.0200
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere