Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery Curvature
Abstract
Graph Neural Networks (GNNs) have demonstrated strong representation learning capabilities for graph-based tasks. Recent advances on GNNs leverage geometric properties, such as curvature, to enhance its representation capabilities by modeling complex connectivity patterns and information flow within graphs. However, most existing approaches focus solely on discrete graph topology, overlooking diffusion dynamics and task-specific dependencies essential for effective learning. To address this, we propose integrating Bakry-Émery curvature, which captures both structural and task-driven aspects of information propagation. We develop an efficient, learnable approximation strategy, making curvature computation scalable for large graphs. Furthermore, we introduce an adaptive depth mechanism that dynamically adjusts message-passing layers per vertex based on its curvature, ensuring efficient propagation. Our theoretical analysis establishes a link between curvature and feature distinctiveness, showing that high-curvature vertices require fewer layers, while low-curvature ones benefit from deeper propagation. Extensive experiments on benchmark datasets validate the effectiveness of our approach, showing consistent performance improvements across diverse graph learning tasks.
Benchmark Results
Tested on 4 datasets 2 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | This paper |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 4 | ID-GNN | 0.9780
±0.0370 | prev best: The Expressive Power of Graph Neural Networks: A Survey (2023) Improvement within reported uncertainty; not highlighted. |
| 10 | GIN+BEC | 0.9610
±0.0360 | This paper |
| 11 | GraphSNN+BEC | 0.9610
±0.0250 | This paper |
| 15 | NC-GNN+BEC | 0.9600
±0.0240 | This paper |
| 21 | GCN+BEC | 0.9500
±0.0300 | This paper |
| 39 | GIN | 0.9330
±0.0290 | |
| 48 | NC-GNN | 0.9280
±0.0500 | prev best: Empowering GNNs via Edge-Aware Weisfeiler-Leman Algorithm (TMLR 2022) Improvement within reported uncertainty; not highlighted. |
| 63 | GCN | 0.9220
±0.0440 | prev best: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) Improvement within reported uncertainty; not highlighted. |
| 403 | MLP | 0.8660
±0.0495 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | ID-GNN+BEC | 0.8150
±0.0240 | This paper |
| 2 | GIN+BEC | 0.8080
±0.0330 | This paper |
| 3 | GCN+BEC | 0.7990
±0.0340 | This paper |
| 4 | GCN | 0.7980
±0.0230 | prev best: Contrastive Multi-View Representation Learning on Graphs (ICML 2020) |
| 5 | NC-GNN+BEC | 0.7960
±0.0360 | This paper |
| 6 | GraphSNN+BEC | 0.7940
±0.0270 | This paper |
| 7 | ID-GNN | 0.7930
±0.0290 | This paper |
| 9 | GraphSNN | 0.7850
±0.0230 | This paper |
| 11 | NC-GNN | 0.7840
±0.0400 | This paper |
| 14 | GIN | 0.7810
±0.0350 | prev best: Graph Learning with Distributional Edge Layouts (2024) Improvement within reported uncertainty; not highlighted. |
| 99 | GraphSAGE | 0.7230
±0.0530 |
Heterophilic Graphs
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | P^2GNN | 0.9672
±0.0147 | |
| 2 | DoG | 0.9660
±0.0210 | |
| 3 | GPF-plus | 0.9583
±0.0419 | |
| 34 | MLP | 0.9230
±0.0070 | |
| 53 | GraphSAGE | 0.9000
±0.0365 | |
| 65 | GraphSAGE+BEC | 0.8941
±0.0306 | This paper |
| 86 | MixHop+BEC | 0.8823
±0.0175 | This paper |
| 92 | DIR-GNN+BEC | 0.8784
±0.0301 | This paper |
| 218 | Dir-GNN | 0.8140
±0.0240 | This paper |
| 310 | GCN+BEC | 0.7568
±0.0218 | This paper |
| 330 | SGC | 0.7440
±0.0600 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 375 | GAT+BEC | 0.7156
±0.0556 | This paper |
| 393 | SGC+BEC | 0.6980
±0.0179 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | P^2GNN | 0.9541
±0.0272 | |
| 2 | ACM-GCN | 0.9480
±0.0380 | |
| 3 | RF-GCN | 0.9429 | |
| 24 | MLP | 0.9136
±0.0070 | |
| 77 | DIR-GNN+BEC | 0.8594
±0.0378 | This paper |
| 138 | SAGE | 0.8269 | |
| 167 | GraphSAGE+BEC | 0.8108
±0.0382 | This paper |
| 193 | MixHop+BEC | 0.7837
±0.0270 | This paper |
| 252 | SGC | 0.7350
±0.0430 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 329 | SGC+BEC | 0.6513
±0.0329 | This paper |
| 361 | GCN+BEC | 0.6162
±0.0464 | This paper |
| 362 | GAT+BEC | 0.6162
±0.0564 | This paper |
