FloydNet: A Learning Paradigm for Global Relational Reasoning
Abstract
Developing models capable of complex, multi-step reasoning is a central goal in artificial intelligence. While representing problems as graphs is a powerful approach, Graph Neural Networks (GNNs) are fundamentally constrained by their message-passing mechanism, which imposes a local bottleneck that limits global, holistic reasoning. We argue that dynamic programming (DP), which solves problems by iteratively refining a global state, offers a more powerful and suitable learning paradigm. We introduce FloydNet, a new architecture that embodies this principle. In contrast to local message passing, FloydNet maintains a global, all-pairs relationship tensor and learns a generalized DP operator to progressively refine it. This enables the model to develop a task-specific relational calculus, providing a principled framework for capturing long-range dependencies. Theoretically, we prove that FloydNet achieves 3-WL expressive power (equivalently, 2-FWL), and that its higher-order generalization aligns with the k-FWL hierarchy. FloydNet demonstrates state-of-the-art performance across challenging domains: it achieves near-perfect scores (often >99\
Benchmark Results
Tested on 6 datasets 13 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | MAE ↓ | Paper |
|---|---|---|---|
| 1 | TIGT | 0.0140
±0.0010 | |
| 2 | FloydNet | 0.0160 | This paper |
| 3 | GSSC | 0.0190
±0.0010 | |
| 17 | Local 2-GNN | 0.0240 | This paper |
| 18 | ET+RRWP | 0.0240 | prev best: Towards Principled Graph Transformers (NeurIPS 2024) |
| 22 | Graphormer | 0.0250 | This paper |
| 28 | Subgraph GNN | 0.0280 | This paper |
| 36 | MPNN | 0.0300 | prev best: Hyperbolic Graph Neural Networks (NeurIPS 2019) |
| 69 | GIN | 0.0880
±0.0020 |
LRGB
| # | Model | MAE ↓ | Paper |
|---|---|---|---|
| 1 | GCN | 0.2421
±0.0016 best reported | best at pub: Can Classic GNNs Be Strong Baselines for Graph-level Tasks? Simple Architectures Meet Excellence (ICML 2025) best today: From Message-Passing to Linearized Graph Sequence Models (2026) |
| 2 | IPR-MPNN | 0.2422
±0.0007 | |
| 3 | TANGO-GPS | 0.2422
±0.0014 | |
| 5 | GIN | 0.2429
±0.0019 | |
| 62 | Graph-Mamba | 0.2478 | This paper |
| 66 | Exphormer | 0.2481
±0.0007 best reported | best at pub: Understanding Virtual Nodes: Oversquashing and Node Heterogeneity (ICLR 2024) best today: On The Expressive Power of GNN Derivatives (2025) |
| 85 | GPS | 0.2500 | This paper |
| 148 | FloydNet | 0.2612 | This paper |
| 201 | MLP | 0.4351
±0.0008 |
| # | Model | AP ↑ | Paper |
|---|---|---|---|
| 1 | S^2GCN | 0.7311
±0.0066 | |
| 2 | S4G | 0.7293
±0.0004 | |
| 3 | BuNN | 0.7276
±0.0065 | |
| 4 | GCN | 0.7261
±0.0011 best reported | best at pub: Where Did the Gap Go? Reassessing the Long-Range Graph Benchmark (TMLR 2023) best today: From Message-Passing to Linearized Graph Sequence Models (2026) |
| 26 | GIN | 0.7059
±0.0089 | |
| 62 | Graph-Mamba | 0.6739 | This paper |
| 87 | GPS | 0.6562
±0.0115 best reported | best at pub: A Generalization of ViT/MLP-Mixer to Graphs (ICML 2022) Difference within reported uncertainty; not counted as underperformance. |
| 95 | Exphormer | 0.6527
±0.0043 best reported | best at pub: Bundle Neural Networks for message diffusion on graphs (2024) best today: On The Expressive Power of GNN Derivatives (2025) |
| 127 | FloydNet | 0.6224 | This paper |
| 181 | MLP | 0.4060
±0.0021 |
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | NeuralWalker | 0.4912
±0.0042 | |
| 2 | PPGT | 0.4641
±0.0033 | |
| 3 | CRaWl | 0.4588
±0.0079 | |
| 14 | GPS | 0.4440
±0.0065 best reported | best at pub: Where Did the Gap Go? Reassessing the Long-Range Graph Benchmark (TMLR 2023) best today: Plain Transformers Can be Powerful Graph Learners (2025) |
| 19 | Exphormer | 0.4242
±0.0044 best reported | best at pub: Benchmarking Positional Encodings for GNNs and Graph Transformers (KDD 2024) |
| 26 | Graph-Mamba | 0.4191 | This paper |
| 32 | FloydNet | 0.4046 | This paper |
| 41 | GatedGCN | 0.3880
±0.0040 | |
| 81 | GCN | 0.2380
±0.0160 best reported | best at pub: When Graph Neural Networks Meet Dynamic Mode Decomposition (ICLR 2024) |
| 93 | MLP | 0.1140
±0.0230 |
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | FloydNet | 0.6143 | This paper |
| 2 | Exphormer | 0.4737
±0.0024 best reported | best at pub: Benchmarking Positional Encodings for GNNs and Graph Transformers (KDD 2024) |
| 3 | Exphormer + LapPE | 0.4737
±0.0024 | |
| 5 | GPS | 0.4703
±0.0014 best reported | best at pub: Learning Long Range Dependencies on Graphs via Random Walks (ICLR 2024) |
| 8 | GatedGCN | 0.4670
±0.0004 | |
| 16 | GIN | 0.4617
±0.0005 | |
| 28 | GCN | 0.4526
±0.0006 best reported | best at pub: Learning Long Range Dependencies on Graphs via Random Walks (ICLR 2024) best today: Benchmarking Positional Encodings for GNNs and Graph Transformers (KDD 2024) |
| 55 | Graph-Mamba | 0.3395 | This paper |
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | FloydNet | 0.4901 | This paper |
| 2 | CRaWl | 0.4588
±0.0079 | |
| 3 | GPS | 0.4440
±0.0065 best reported | best at pub: Where Did the Gap Go? Reassessing the Long-Range Graph Benchmark (TMLR 2023) |
| 10 | Exphormer | 0.3960
±0.0027 best reported | best at pub: A Scalable and Effective Alternative to Graph Transformers (AAAI 2024) |
| 11 | Graph-Mamba | 0.3960 | This paper |
| 16 | GatedGCN | 0.3880
±0.0040 | |
| 45 | GCN | 0.2078
±0.0031 best reported | best at pub: Where Did the Gap Go? Reassessing the Long-Range Graph Benchmark (TMLR 2023) |
| 74 | MLP | 0.0310
±0.0160 |
