Polynomial Selection in Spectral Graph Neural Networks: An Error-Sum of Function Slices Approach
Abstract
Spectral graph neural networks are proposed to harness spectral information inherent in graph-structured data through the application of polynomial-defined graph filters, recently achieving notable success in graph-based web applications. Existing studies reveal that various polynomial choices greatly impact spectral GNN performance, underscoring the importance of polynomial selection. However, this selection process remains a critical and unresolved challenge. Although prior work suggests a connection between the approximation capabilities of polynomials and the efficacy of spectral GNNs, there is a lack of theoretical insights into this relationship, rendering polynomial selection a largely heuristic process. To address the issue, this paper examines polynomial selection from an error-sum of function slices perspective. Inspired by the conventional signal decomposition, we represent graph filters as a sum of disjoint function slices. Building on this, we then bridge the polynomial capability and spectral GNN efficacy by proving that the construction error of graph convolution layer is bounded by the sum of polynomial approximation errors on function slices. This result leads us to develop an advanced filter based on trigonometric polynomials, a widely adopted option for approximating narrow signal slices. The proposed filter remains provable parameter efficiency, with a novel Taylor-based parameter decomposition that achieves streamlined, effective implementation. With this foundation, we propose TFGNN, a scalable spectral GNN operating in a decoupled paradigm. We validate the efficacy of TFGNN via benchmark node classification tasks, along with an example graph anomaly detection application to show its practical utility.
Benchmark Results
Tested on 3 datasets 10 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 best reported | best at pub: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 38 | TFGNN | 0.8921
±0.0040 | This paper |
| 39 | SAGE | 0.8911
±0.0012 | |
| 45 | GCNII | 0.8893
±0.0137 best reported | best at pub: Language is All a Graph Needs (2023) best today: Large Language Model Meets Graph Neural Network in Knowledge Distillation (AAAI 2024) |
| 51 | H2GCN | 0.8882
±0.0011 best reported | best at pub: Feature Transportation Improves Graph Neural Networks (AAAI 2023) |
| 64 | JacobiConv | 0.8853
±0.0080 | This paper |
| 65 | BernNet | 0.8852
±0.0095 best reported | best at pub: Language is All a Graph Needs (2023) best today: Large Language Model Meets Graph Neural Network in Knowledge Distillation (AAAI 2024) Difference within reported uncertainty; not counted as underperformance. |
| 72 | OptBasis | 0.8835
±0.0060 | This paper |
| 73 | UniFilter | 0.8831
±0.0070 | This paper |
| 77 | GPRGNN | 0.8826
±0.0050 | prev best: From Node Interaction to Hop Interaction: New Effective and Scalable Graph Learning Paradigm (2022) Improvement within reported uncertainty; not highlighted. |
| 81 | AdaptKry | 0.8823
±0.0070 | This paper |
| 85 | Specformer | 0.8819
±0.0060 | This paper |
| 86 | ChebNetII | 0.8817
±0.0040 | This paper |
| 88 | GloGNN | 0.8812
±0.0040 | This paper |
| 91 | NFGNN | 0.8806
±0.0040 | This paper |
| 120 | OrderGNN | 0.8755
±0.0020 | This paper |
| 122 | LRGNN | 0.8748
±0.0030 | This paper |
| 133 | ACMGCN | 0.8721
±0.0040 | This paper |
| 139 | ChebNet | 0.8712
±0.0060 best reported | best at pub: SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels (2017) Difference within reported uncertainty; not counted as underperformance. |
| 243 | LINKX | 0.8464
±0.0113 best reported | best at pub: Feature Transportation Improves Graph Neural Networks (AAAI 2023) best today: Graph Neural Reaction Diffusion Models Submitted to the editors June 2023. Accepted in March 2024. (2024) Difference within reported uncertainty; not counted as underperformance. |
| 724 | MLP | 0.7768 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 16 | H2GCN | 0.9361
±0.0013 best reported | best at pub: Optimization-Induced Graph Implicit Nonlinear Diffusion (ICML 2022) |
| 18 | GCN | 0.9296
±0.0015 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 58 | GCNII | 0.9030
±0.0043 best reported | best at pub: Feature Transportation Improves Graph Neural Networks (AAAI 2023) |
| 72 | TFGNN | 0.9000
±0.0020 | This paper |
| 85 | GloGNN | 0.8960
±0.0040 best reported | best at pub: Graph Contrastive Learning under Heterophily via Graph Filters (2023) |
| 87 | JacobiConv | 0.8951
±0.0020 | This paper |
| 89 | Specformer | 0.8947
±0.0048 best reported | |
| 92 | OptBasis | 0.8938
±0.0030 | This paper |
| 93 | BernNet | 0.8933
±0.0007 best reported | best at pub: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 94 | UniFilter | 0.8930
±0.0040 | This paper |
| 101 | GPRGNN | 0.8911
±0.0008 best reported | best at pub: Feature Expansion for Graph Neural Networks (ICML 2023) Difference within reported uncertainty; not counted as underperformance. |
| 110 | ChebNetII | 0.8898
±0.0040 | This paper |
| 116 | SAGE | 0.8881
±0.0015 | |
| 124 | LRGNN | 0.8865
±0.0040 | This paper |
| 134 | NFGNN | 0.8843
±0.0040 | This paper |
| 137 | AdaptKry | 0.8838
±0.0060 | This paper |
| 143 | OrderGNN | 0.8831
±0.0030 | This paper |
| 162 | LINKX | 0.8786
±0.0077 best reported | best at pub: Feature Transportation Improves Graph Neural Networks (AAAI 2023) |
| 192 | ACMGCN | 0.8737
±0.0040 | This paper |
| 199 | ChebNet | 0.8718
±0.0029 best reported | best at pub: Non-backtracking Graph Neural Networks (TMLR 2023) |
| 210 | MLP | 0.8690
±0.0074 |
OGB
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | SGC | 0.7910 best reported | best at pub: Unifews: You Need Fewer Operations for Efficient Graph Neural Networks (ICML 2024) |
| 2 | GAMLP | 0.7036
±0.0002 | |
| 3 | GLEM-GNN | 0.7036
±0.0002 | |
| 7 | TFGNN | 0.6865
±0.0020 | This paper |
| 21 | ChebNetII | 0.6718
±0.0032 best reported | best at pub: Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited (NeurIPS 2022) best today: Graph Neural Networks with Learnable and Optimal Polynomial Bases (ICML 2023) Difference within reported uncertainty; not counted as underperformance. |
| 23 | AdaptKry | 0.6707
±0.0020 | This paper |
| 25 | OptBasis | 0.6703
±0.0030 | This paper |
| 28 | UniFilter | 0.6679
±0.0030 | This paper |
| 35 | SAGE | 0.6644
±0.0017 | |
| 37 | NFGNN | 0.6638
±0.0020 | This paper |
| 45 | GPRGNN | 0.6613
±0.0020 | This paper |
| 47 | BernNet | 0.6608
±0.0020 | This paper |
| 56 | JacobiConv | 0.6545
±0.0020 | This paper |
| 95 | MLP | 0.4960
±0.0030 |
