Using Random Noise Equivariantly to Boost Graph Neural Networks Universally
Abstract
Recent advances in Graph Neural Networks (GNNs) have explored the potential of random noise as an input feature to enhance expressivity across diverse tasks. However, naively incorporating noise can degrade performance, while architectures tailored to exploit noise for specific tasks excel yet lack broad applicability. This paper tackles these issues by laying down a theoretical framework that elucidates the increased sample complexity when introducing random noise into GNNs without careful design. We further propose Equivariant Noise GNN (ENGNN), a novel architecture that harnesses the symmetrical properties of noise to mitigate sample complexity and bolster generalization. Our experiments demonstrate that using noise equivariantly significantly enhances performance on node-level, link-level, subgraph, and graph-level tasks and achieves comparable performance to models designed for specific tasks, thereby offering a general method to boost expressivity across various graph tasks.
Benchmark Results
Tested on 3 datasets 10 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | MAE ↓ | Paper |
|---|---|---|---|
| 1 | TIGT | 0.0140
±0.0010 | |
| 2 | FloydNet | 0.0160 | |
| 3 | GSSC | 0.0190
±0.0010 | |
| 7 | CIN | 0.0210
±0.0010 best reported | best at pub: CIN++: Enhancing Topological Message Passing (2023) Difference within reported uncertainty; not counted as underperformance. |
| 10 | SSWL+ | 0.0220
±0.0020 | This paper |
| 21 | SUN | 0.0240
±0.0030 | This paper |
| 24 | DRFWL | 0.0250
±0.0030 | This paper |
| 33 | ESAN | 0.0290
±0.0030 | This paper |
| 31 | NGNN | 0.0290
±0.0010 | This paper |
| 36 | MPNN | 0.0300 best reported | best at pub: Hyperbolic Graph Neural Networks (NeurIPS 2019) best today: FloydNet: A Learning Paradigm for Global Relational Reasoning (2026) |
| 52 | ENGNN | 0.0440
±0.0020 | This paper |
| 56 | NMPNN | 0.0510
±0.0040 | This paper |
| 69 | GIN | 0.0880
±0.0020 | This paper |
| 79 | GCN | 0.1130
±0.0020 |
OGB
| # | Model | Hits@20 ↑ | Paper |
|---|---|---|---|
| 1 | ELGNN | 0.9777
±0.0037 | |
| 2 | GIDN | 0.9542 | |
| 3 | AGDN | 0.9538
±0.0094 | |
| 16 | BUDDY | 0.7851
±0.0136 | This paper |
| 17 | ENGNN | 0.7761
±0.0450 | This paper |
| 20 | SAGE | 0.6719
±0.0118 best reported | best at pub: Link Prediction with Untrained Message Passing Layers (2024) |
| 24 | GCN | 0.6476
±0.0145 best reported | best at pub: Link Prediction with Untrained Message Passing Layers (2024) |
| 26 | Neo-GNN | 0.6357
±0.0352 | This paper |
| 38 | GraphSAGE | 0.5390
±0.0474 | |
| 43 | SEAL | 0.4974
±0.0239 best reported | best at pub: Link Prediction with Untrained Message Passing Layers (2024) |
| 47 | RA | 0.4401 best reported | best at pub: Link Prediction with Untrained Message Passing Layers (2024) |
| 50 | AA | 0.3975 best reported | best at pub: Link Prediction with Untrained Message Passing Layers (2024) |
| 51 | CN | 0.3869 best reported | best at pub: Link Prediction with Untrained Message Passing Layers (2024) |
| 66 | MPNN | 0.2476
±0.1529 | This paper |
| 69 | NMPNN | 0.2308
±0.0589 | This paper |
| 94 | NBFnet | 0.0400
±0.0058 | This paper |
| # | Model | Hits@100 ↑ | Paper |
|---|---|---|---|
| 1 | OGB Leader | 0.6524
±0.0150 | |
| 2 | PRB | 0.6347
±0.0175 | |
| 3 | LPFormer | 0.6332
±0.0063 | |
| 9 | RA | 0.5324 best reported | best at pub: Pairwise Learning for Neural Link Prediction (2021) |
| 14 | SAGE | 0.5013
±0.0055 best reported | best at pub: Asymmetric Learning for Graph Neural Network based Link Prediction (2023) |
| 15 | BUDDY | 0.4985
±0.0020 | This paper |
| 18 | Neo-GNN | 0.4913
±0.0060 | This paper |
| 19 | SEAL | 0.4880
±0.0316 | This paper |
| 23 | MLP | 0.4600 | |
| 29 | ENGNN | 0.4497
±0.0074 | This paper |
| 33 | NMPNN | 0.3990
±0.0552 | This paper |
| 39 | AA | 0.3245 | This paper |
| 45 | GCN | 0.3084
±0.0178 best reported | best at pub: Link Prediction with Untrained Message Passing Layers (2024) |
| 49 | CN | 0.2765 | This paper |
| 63 | GraphSAGE | 0.1655
±0.0240 | |
| 70 | MPNN | 0.0562
±0.0252 | This paper |
