Graph Neural Networks With Convolutional ARMA Filters
Abstract
Popular graph neural networks implement convolution operations on graphs based on polynomial spectral filters. In this paper, we propose a novel graph convolutional layer inspired by the auto-regressive moving average (ARMA) filter that, compared to polynomial ones, provides a more flexible frequency response, is more robust to noise, and better captures the global graph structure. We propose a graph neural network implementation of the ARMA filter with a recursive and distributed formulation, obtaining a convolutional layer that is efficient to train, localized in the node space, and can be transferred to new graphs at test time. We perform a spectral analysis to study the filtering effect of the proposed ARMA layer and report experiments on four downstream tasks: semi-supervised node classification, graph signal classification, graph classification, and graph regression. Results show that the proposed ARMA layer brings significant improvements over graph neural networks based on polynomial filters.
Benchmark Results
Tested on 7 datasets 2 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 35 | GAT | 0.8080
±0.0026 best reported | best at pub: Topology Adaptive Graph Convolutional Networks (2017) best today: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 44 | GCN | 0.8033
±0.0088 best reported | best at pub: Topology Adaptive Graph Convolutional Networks (2017) |
| 61 | GraphSAGE | 0.7923
±0.0053 best reported | best today: Gophormer: Ego-Graph Transformer for Node Classification (2021) |
| 259 | SAGE | 0.7361
±0.0190 | |
| 350 | MLP | 0.7289
±0.0010 | |
| 390 | ARMA | 0.7250
±0.0040 | This paper |
| 389 | GIN | 0.7250
±0.0080 best reported | best today: Towards Self-Explainable Graph Neural Network (2021) |
| 617 | Chebyshev | 0.7010
±0.0080 | This paper |
| 719 | CayleyNet | 0.6710
±0.0240 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 18 | GCN | 0.9296
±0.0015 best reported | best at pub: Topology Adaptive Graph Convolutional Networks (2017) |
| 20 | GAT | 0.9233
±0.0018 best reported | best at pub: Topology Adaptive Graph Convolutional Networks (2017) |
| 116 | SAGE | 0.8881
±0.0015 | |
| 125 | GraphSAGE | 0.8864
±0.0030 best reported | best today: Non-backtracking Graph Neural Networks (TMLR 2023) |
| 157 | GIN | 0.8810 best reported | best today: UGSL: A Unified Framework for Benchmarking Graph Structure Learning (2023) |
| 210 | MLP | 0.8690
±0.0074 | |
| 217 | ARMA | 0.8678
±0.0021 best reported | |
| 780 | CayleyNet | 0.7560
±0.0360 | This paper |
| 807 | Chebyshev | 0.7440
±0.0110 | This paper |
| # | Model | F1 ↑ | Paper |
|---|---|---|---|
| 1 | GAMLP(JK) | 0.9982
±0.0001 | |
| 2 | GraphCON-GCN | 0.9960 | |
| 3 | GCNII | 0.9953
±0.0001 | |
| 21 | GCN | 0.9850 best reported | best today: Graph-Coupled Oscillator Networks (ICML 2022) |
| 57 | GAT | 0.9732
±0.0032 best reported | |
| 89 | ARMA | 0.9050
±0.0030 | This paper |
| 92 | GIN | 0.8724
±0.0002 best reported | best today: Search to aggregate neighborhood for graph neural network (2021) |
| 93 | Chebyshev | 0.8640
±0.0010 | This paper |
| 96 | CayleyNet | 0.8490
±0.0120 | This paper |
| 101 | GraphSAGE | 0.7000 | best today: Optimization-Induced Graph Implicit Nonlinear Diffusion (ICML 2022) |
| 132 | SAGE | 0.6928 | |
| 173 | MLP | 0.4620 |
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best today: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 63 | GCN | 0.9220
±0.0440 best reported | best today: Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery Curvature (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 89 | ARMA | 0.9150
±0.0420 | This paper |
| 158 | GraphSAGE | 0.9040
±0.0780 best reported | best today: Asynchronous Neural Networks for Learning in Graphs (2022) Difference within reported uncertainty; not counted as underperformance. |
| 183 | GAT | 0.9010
±0.0580 best reported | best today: The Expressive Power of Graph Neural Networks: A Survey (2023) Difference within reported uncertainty; not counted as underperformance. |
| 344 | CayleyNet | 0.8780
±0.1000 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 540 | Chebyshev | 0.8260
±0.0520 | This paper |
| 718 | SAGE | 0.7490
±0.0870 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 32 | GIN | 0.7880
±0.0410 best reported | best today: Permutation-Invariant graph partitioning: How graph neural networks capture structural interactions? (2023) Difference within reported uncertainty; not counted as underperformance. |
| 49 | GAT | 0.7800
±0.0300 best reported | |
| 67 | SAGE | 0.7726
±0.0228 | |
| 148 | GCN | 0.7600
±0.0320 best reported | best today: Simplifying Graph Convolutional Networks with Redundancy-Free Neighbors (2025) Difference within reported uncertainty; not counted as underperformance. |
| 149 | MLP | 0.7600
±0.0320 | |
| 155 | GraphSAGE | 0.7590
±0.0320 best reported | best today: Simplifying Graph Convolutional Networks with Redundancy-Free Neighbors (2025) Difference within reported uncertainty; not counted as underperformance. |
| 326 | ARMA | 0.7370
±0.0340 | This paper |
| 405 | Chebyshev | 0.7210
±0.0350 | This paper |
| 482 | CayleyNet | 0.6560
±0.0570 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GMN | 0.7866 | |
| 2 | MemGNN | 0.7550 | |
| 3 | TFGW SP | 0.7510
±0.0500 | |
| 17 | GatedGCN | 0.7000
±0.0494 | |
| 20 | GAT | 0.6850
±0.0524 best reported | best today: GNNBenchmark (JMLR 2023) |
| 26 | GraphSAGE | 0.6817
±0.0545 best reported | best today: GNNBenchmark (JMLR 2023) Difference within reported uncertainty; not counted as underperformance. |
| 32 | GIN | 0.6767
±0.0583 best reported | best today: GNNBenchmark (JMLR 2023) |
| 36 | GCN | 0.6650
±0.0691 best reported | best today: Hierarchical Graph Capsule Network (AAAI 2020) |
| 90 | ARMA | 0.6060
±0.0720 | This paper |
| 117 | Chebyshev | 0.5790
±0.0260 | This paper |
| 124 | MLP | 0.5583
±0.0352 | |
| 126 | SAGE | 0.5550
±0.0511 | |
| 177 | CayleyNet | 0.4310
±0.1070 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GC-GNN (GCN) | 0.9210
±0.0810 | |
| 2 | SUGAR | 0.8403
±0.0133 | |
| 3 | Ortho-g-U-Nets | 0.8387 | |
| 15 | SAGE | 0.8088
±0.0233 | |
| 43 | GCN | 0.7912
±0.0307 best reported | best today: Hierarchical Graph Capsule Network (AAAI 2020) Difference within reported uncertainty; not counted as underperformance. |
| 74 | GIN | 0.7805
±0.0189 best reported | best today: Multi-grained Semantics-aware Graph Neural Networks (2020) Difference within reported uncertainty; not counted as underperformance. |
| 86 | ARMA | 0.7760
±0.0270 | This paper |
| 99 | GAT | 0.7730
±0.0368 best reported | best today: Contrastive Self-supervised Learning for Graph Classification (AAAI 2020) Difference within reported uncertainty; not counted as underperformance. |
| 109 | GraphSAGE | 0.7660 best reported | best today: Graph Convolutional Networks with EigenPooling (KDD 2019) Difference within reported uncertainty; not counted as underperformance. |
| 153 | Chebyshev | 0.7370
±0.0370 | This paper |
| 170 | CayleyNet | 0.7030
±0.1160 | This paper |
