Piecewise Constant Spectral Graph Neural Network
Abstract
Graph Neural Networks (GNNs) have achieved significant success across various domains by leveraging graph structures in data. Existing spectral GNNs, which use low-degree polynomial filters to capture graph spectral properties, may not fully identify the graph's spectral characteristics because of the polynomial's small degree. However, increasing the polynomial degree is computationally expensive and, beyond certain thresholds, leads to performance plateaus or degradation. In this paper, we introduce the Piecewise Constant Spectral Graph Neural Network (PieCoN) to address these challenges. PieCoN combines constant spectral filters with polynomial filters to provide a more flexible way to leverage the graph structure. By adaptively partitioning the spectrum into intervals, our approach increases the range of spectral properties that can be effectively learned. Experiments on nine benchmark datasets, including both homophilic and heterophilic graphs, demonstrate that PieCoN is particularly effective on heterophilic datasets, highlighting its potential for a wide range of applications. The implementation of PieCoN is available at.
Benchmark Results
Tested on 4 datasets 13 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9703
±0.0019 | |
| 2 | GAT | 0.9669
±0.0014 best reported | |
| 3 | GAT+T | 0.9660
±0.0007 | |
| 7 | SAGE | 0.9643
±0.0027 | |
| 8 | GCN | 0.9632
±0.0008 best reported | |
| 18 | Specformer | 0.9580
±0.0026 best reported | best at pub: NTFormer: A Composite Node Tokenized Graph Transformer for Node Classification (2024) |
| 25 | PieCoN | 0.9565
±0.0034 | This paper |
| 35 | JacobiConv | 0.9543
±0.0023 best reported | best at pub: LON-GNN: Spectral GNNs with Learnable Orthonormal Basis (2023) best today: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) Difference within reported uncertainty; not counted as underperformance. |
| 55 | PPGNN | 0.9509
±0.0031 | This paper |
| 61 | UniFilter | 0.9496
±0.0074 | This paper |
| 62 | ChebNetII | 0.9492
±0.0033 | prev best: A Quasi-Wasserstein Loss for Learning Graph Neural Networks (WWW 2023) |
| 63 | DSF-Jacobi-R | 0.9490
±0.0031 | This paper |
| 70 | OptBasisGNN | 0.9471
±0.0033 | This paper |
| 87 | GCNII | 0.9430
±0.0020 best reported | best at pub: Polynormer: Polynomial-Expressive Graph Transformer in Linear Time (ICLR 2024) |
| 112 | GPR-GNN | 0.9385
±0.0028 | This paper |
| 118 | ChebyNet | 0.9377
±0.0032 | This paper |
| 127 | BernNet | 0.9368
±0.0028 best reported | best at pub: A Quasi-Wasserstein Loss for Learning Graph Neural Networks (WWW 2023) Difference within reported uncertainty; not counted as underperformance. |
| 190 | LanczosNet | 0.9321
±0.0085 | This paper |
| 218 | H_2GCN | 0.9302
±0.0091 | This paper |
| 390 | MLP | 0.9128
±0.0063 | |
| 502 | Free eigenvalues | 0.8608
±0.0081 | This paper |
Heterophilic Graphs
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | P^2GNN | 0.9672
±0.0147 | |
| 2 | DoG | 0.9660
±0.0210 | |
| 3 | GPF-plus | 0.9583
±0.0419 | |
| 20 | OptBasisGNN | 0.9348
±0.0168 best reported | best at pub: Simplified PCNet with Robustness (2024) |
| 21 | JacobiConv | 0.9344
±0.0213 best reported | best at pub: Simplified PCNet with Robustness (2024) best today: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) |
| 22 | BernNet | 0.9328
±0.0148 best reported | best at pub: A Quasi-Wasserstein Loss for Learning Graph Neural Networks (WWW 2023) Difference within reported uncertainty; not counted as underperformance. |
| 23 | ChebNetII | 0.9328
±0.0147 best reported | best at pub: Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited (NeurIPS 2022) best today: Simplified PCNet with Robustness (2024) Difference within reported uncertainty; not counted as underperformance. |
| 30 | GPR-GNN | 0.9291
±0.0132 best reported | best at pub: Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited (NeurIPS 2022) Difference within reported uncertainty; not counted as underperformance. |
| 34 | MLP | 0.9230
±0.0070 | |
| 40 | H2GCN | 0.9189
±0.0393 best reported | best at pub: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) Difference within reported uncertainty; not counted as underperformance. |
| 53 | GraphSAGE | 0.9000
±0.0365 | |
| 67 | PieCoN | 0.8934
±0.0311 | This paper |
| 70 | GCNII | 0.8918
±0.0443 | prev best: Global-Local Graph Neural Networks for Node-Classification (2024) |
| 71 | DSF-Jacobi-R | 0.8918
±0.0344 | This paper |
| 87 | Specformer | 0.8823
±0.0038 best reported | best at pub: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) Difference within reported uncertainty; not counted as underperformance. |
| 88 | Free eigenvalues | 0.8820
±0.0328 | This paper |
| 105 | UniFilter | 0.8672
±0.0377 | This paper |
| 113 | ChebyNet | 0.8622
±0.0245 best reported | best at pub: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) |
| 132 | PPGNN | 0.8557
±0.0262 | This paper |
| 211 | GAT | 0.8162
±0.0645 best reported | best at pub: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) best today: Equivariance Everywhere All At Once: A Recipe for Graph Foundation Models (2025) |
| 257 | GCN | 0.7933
±0.0447 best reported | best at pub: Graph Wave Networks (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 299 | LanczosNet | 0.7639
±0.0443 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | DiGGR | 0.4535
±0.0353 | |
| 2 | TRIGON | 0.4402
±0.0028 | |
| 3 | DoG | 0.4320
±0.0120 | |
| 11 | OptBasisGNN | 0.4239
±0.0052 | This paper |
| 19 | Specformer | 0.4193
±0.0104 best reported | best at pub: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) Difference within reported uncertainty; not counted as underperformance. |
| 21 | BernNet | 0.4179
±0.0101 | This paper |
| 22 | ChebNetII | 0.4175
±0.0107 | This paper |
| 24 | Free eigenvalues | 0.4161
±0.0063 | This paper |
| 34 | JacobiConv | 0.4117
±0.0064 best reported | best at pub: Graph Neural Networks with Learnable and Optimal Polynomial Bases (ICML 2023) best today: GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers (ICML 2024) Difference within reported uncertainty; not counted as underperformance. |
| 38 | GCNII | 0.4082
±0.0179 best reported | best at pub: Feature Expansion for Graph Neural Networks (ICML 2023) best today: $P^2$GNN: Two Prototype Sets to boost GNN Performance (2026) |
| 42 | MLP | 0.4026
±0.0108 | |
| 44 | UniFilter | 0.4011
±0.0131 | This paper |
| 53 | GPR-GNN | 0.3992
±0.0067 | prev best: Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited (NeurIPS 2022) Improvement within reported uncertainty; not highlighted. |
| 54 | DSF-Jacobi-R | 0.3989
±0.0054 | This paper |
| 57 | PPGNN | 0.3965
±0.0066 | This paper |
| 64 | ChebyNet | 0.3917
±0.0143 best reported | best at pub: Heterophily-Aware Graph Attention Network (2023) Difference within reported uncertainty; not counted as underperformance. |
| 68 | GraphSAGE | 0.3899
±0.0085 | |
| 71 | H2GCN | 0.3885
±0.0117 best reported | best at pub: ES-GNN: Generalizing Graph Neural Networks Beyond Homophily with Edge Splitting (2022) best today: $P^2$GNN: Two Prototype Sets to boost GNN Performance (2026) |
| 84 | LanczosNet | 0.3816
±0.0091 | This paper |
| 135 | GCN | 0.3690 best reported | best at pub: Beyond Low-frequency Information in Graph Convolutional Networks (AAAI 2021) |
| 182 | GAT | 0.3605
±0.0035 best reported | best at pub: Hierarchical Graph Transformer with Adaptive Node Sampling (NeurIPS 2022) Difference within reported uncertainty; not counted as underperformance. |
Heterophily Benchmark
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | UniGAP | 0.6375
±0.0110 | |
| 2 | H2GCN + HalfHop | 0.5961
±0.0100 | |
| 3 | GraphSAGE + HalfHop | 0.5897
±0.0150 | |
| 7 | H2GCN | 0.5681
±0.0090 best reported | |
| 12 | SAGE | 0.5569
±0.0023 | |
| 14 | GAT | 0.5028
±0.0055 | prev best: Graph Neural Networks for Graphs with Heterophily: A Survey (2022) |
| 24 | GCN | 0.5411
±0.0034 best reported | |
| 56 | PieCoN | 0.5237
±0.0050 | This paper |
| 84 | MLP | 0.5058 | |
| 87 | ChebyNet | 0.5020
±0.0052 | This paper |
| 92 | UniFilter | 0.5002
±0.0070 | This paper |
| 103 | GPR-GNN | 0.4937
±0.0071 | prev best: Evolving Computation Graphs (ICML 2023) |
| 109 | BernNet | 0.4882
±0.0020 | This paper |
| 110 | OptBasisGNN | 0.4880
±0.0021 | This paper |
| 111 | ChebNetII | 0.4879
±0.0021 | This paper |
| 112 | DSF-Jacobi-R | 0.4868
±0.0034 | This paper |
| 114 | JacobiConv | 0.4853
±0.0096 | prev best: Evolving Computation Graphs (ICML 2023) |
| 117 | LanczosNet | 0.4835
±0.0040 | This paper |
| 122 | PPGNN | 0.4796
±0.0089 | This paper |
| 135 | GCNII | 0.4660
±0.0120 | This paper |
| 156 | Free eigenvalues | 0.4428
±0.0113 | This paper |
