Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channel
Abstract
Graph Neural Networks (GNNs) have been widely adopted for drug discovery with molecular graphs. Nevertheless, current GNNs mainly excel in leveraging short-range interactions (SRI) but struggle to capture long-range interactions (LRI), both of which are crucial for determining molecular properties. To tackle this issue, we propose a method to abstract the collective information of atomic groups into a few Neural Atoms by implicitly projecting the atoms of a molecular. Specifically, we explicitly exchange the information among neural atoms and project them back to the atoms’ representations as an enhancement. With this mechanism, neural atoms establish the communication channels among distant nodes, effectively reducing the interaction scope of arbitrary node pairs into a single hop. To provide an inspection of our method from a physical perspective, we reveal its connection to the traditional LRI calculation method, Ewald Summation. The Neural Atom can enhance GNNs to capture LRI by approximating the potential LRI of the molecular. We conduct extensive experiments on four long-range graph benchmarks, covering graph-level and link-level tasks on molecular graphs. We achieve up to a 27.32\ Empirically, our method can be equipped with an arbitrary GNN to help capture LRI. Code and datasets are publicly available in.
Benchmark Results
Tested on 1 dataset 1 baseline value reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
LRGB
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | FloydNet | 0.6143 | |
| 2 | Exphormer | 0.4737
±0.0024 | |
| 3 | Exphormer + LapPE | 0.4737
±0.0024 | |
| 8 | GatedGCN | 0.4670
±0.0004 best reported | best at pub: Recipe for a General, Powerful, Scalable Graph Transformer (NeurIPS 2022) best today: Benchmarking Positional Encodings for GNNs and Graph Transformers (KDD 2024) |
| 15 | GINE | 0.4617
±0.0005 best reported | best at pub: Recipe for a General, Powerful, Scalable Graph Transformer (NeurIPS 2022) best today: Benchmarking Positional Encodings for GNNs and Graph Transformers (KDD 2024) |
| 16 | GIN | 0.4617
±0.0005 | |
| 28 | GCN | 0.4526
±0.0006 best reported | best at pub: Recipe for a General, Powerful, Scalable Graph Transformer (NeurIPS 2022) best today: Benchmarking Positional Encodings for GNNs and Graph Transformers (KDD 2024) |
| 61 | SAN+LapPE | 0.3350
±0.0003 | This paper |
| 64 | GraphGPS | 0.3337
±0.0006 | This paper |
| 72 | GatedGCN + Neural Atoms | 0.3258
±0.0003 | This paper |
| 75 | GatedGCN+RWSE | 0.3242
±0.0008 | This paper |
| 80 | Transformer+LapPE | 0.3174
±0.0020 | This paper |
| 82 | GCNII | 0.3161
±0.0004 | This paper |
| 83 | GINE + Neural Atoms | 0.3126
±0.0021 | This paper |
| 85 | GCNII + Neural Atoms | 0.3049
±0.0006 | This paper |
| 88 | GCN + Neural Atoms | 0.2534
±0.0200 | This paper |
