A General Graph Spectral Wavelet Convolution via Chebyshev Order Decomposition
Abstract
Spectral graph convolution, an important tool of data filtering on graphs, relies on two essential decisions: selecting spectral bases for signal transformation and parameterizing the kernel for frequency analysis. While recent techniques mainly focus on standard Fourier transform and vector-valued spectral functions, they fall short in flexibility to model signal distributions over large spatial ranges, and capacity of spectral function. In this paper, we present a novel wavelet-based graph convolution network, namely WaveGC, which integrates multi-resolution spectral bases and a matrix-valued filter kernel. Theoretically, we establish that WaveGC can effectively capture and decouple short-range and long-range information, providing superior filtering flexibility, surpassing existing graph wavelet neural networks. To instantiate WaveGC, we introduce a novel technique for learning general graph wavelets by separately combining odd and even terms of Chebyshev polynomials. This approach strictly satisfies wavelet admissibility criteria. Our numerical experiments showcase the consistent improvements in both short-range and long-range tasks. This underscores the effectiveness of the proposed model in handling different scenarios. Our code is available at https://github.com/liun-online/WaveGC.
Benchmark Results
Tested on 3 datasets 2 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9703
±0.0019 | |
| 2 | GAT | 0.9669
±0.0014 best reported | |
| 3 | GAT+T | 0.9660
±0.0007 | |
| 7 | SAGE | 0.9643
±0.0027 | |
| 8 | GCN | 0.9632
±0.0008 best reported | |
| 21 | APPNP | 0.9573
±0.0012 best reported | best at pub: Polynormer: Polynomial-Expressive Graph Transformer in Linear Time (ICLR 2024) |
| 37 | SGT | 0.9537
±0.0044 | This paper |
| 79 | GWNN | 0.9445
±0.0045 | prev best: Spectral Graph Attention Network with Fast Eigen-approximation (2020) |
| 83 | DEFT | 0.9435
±0.0044 | This paper |
| 84 | SEA-GWNN | 0.9435
±0.0050 | This paper |
| 85 | UFGConvR | 0.9434
±0.0034 | This paper |
| 98 | WaveNet | 0.9409
±0.0063 | This paper |
| 101 | UFGConvS | 0.9398
±0.0059 | This paper |
| 145 | WaveShrink-ChebNet | 0.9354
±0.0090 | This paper |
| 215 | Scattering GCN | 0.9307
±0.0042 | |
| 289 | SGWT | 0.9245
±0.0062 | This paper |
| 335 | Scattering | 0.9210
±0.0061 | This paper |
| 390 | MLP | 0.9128
±0.0063 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphTARIF | 0.9461
±0.0017 | |
| 2 | GCN | 0.9412
±0.0008 best reported | best at pub: Clarify Confused Nodes via Separated Learning (2023) |
| 3 | GAT | 0.9398
±0.0022 best reported | |
| 8 | SAGE | 0.9351
±0.0006 | |
| 21 | WaveGC | 0.9226
±0.0018 | This paper |
| 22 | Matrix-valued | 0.9226 | This paper |
| 25 | WaveNet | 0.9206
±0.0033 | This paper |
| 40 | DEFT | 0.9163
±0.0052 | This paper |
| 58 | APPNP | 0.9093
±0.0018 best reported | best at pub: Polynormer: Polynomial-Expressive Graph Transformer in Linear Time (ICLR 2024) |
| 62 | GWNN | 0.9075
±0.0059 | This paper |
| 106 | Vector-valued | 0.8996 | This paper |
| 113 | SEA-GWNN | 0.8988
±0.0064 | This paper |
| 147 | UFGConvR | 0.8929
±0.0046 | This paper |
| 168 | Scattering GCN | 0.8883
±0.0044 | |
| 176 | UFGConvS | 0.8868
±0.0039 | This paper |
| 200 | WaveShrink-ChebNet | 0.8820
±0.0065 | This paper |
| 298 | Scattering | 0.8568
±0.0071 | This paper |
| 307 | SGWT | 0.8519
±0.0059 | This paper |
| 320 | MLP | 0.8463 |
OGB
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GIANT-XRT | 0.7612
±0.0016 | |
| 2 | GEGCN | 0.7576
±0.0064 | |
| 3 | AGDN | 0.7522
±0.0007 | |
| 15 | GAT | 0.7182
±0.0023 | prev best: Rethinking and Simplifying Bootstrapped Graph Latents (2023) best today: Fully-inductive Node Classification on Arbitrary Graphs (ICLR 2024) |
| 22 | WaveGC | 0.7301
±0.0018 | This paper |
| 23 | GCN | 0.7300
±0.0017 best reported | |
| 25 | GraphSAGE | 0.7277
±0.0016 | |
| 27 | SEA-GWNN | 0.7264
±0.0021 | This paper |
| 40 | DEFT | 0.7201
±0.0020 | This paper |
| 45 | UFGConvR | 0.7197
±0.0012 | This paper |
| 49 | APPNP | 0.7190
±0.0025 | prev best: Node-oriented Spectral Filtering for Graph Neural Networks (2022) Improvement within reported uncertainty; not highlighted. |
| 65 | WaveNet | 0.7137
±0.0014 | This paper |
| 71 | Scattering GCN | 0.7118
±0.0076 | This paper |
| 72 | GWNN | 0.7113
±0.0047 | This paper |
| 86 | UFGConvS | 0.7004
±0.0022 | This paper |
| 89 | SGWT | 0.6908
±0.0030 | This paper |
| 98 | Scattering | 0.6623
±0.0019 | This paper |
| 107 | MLP | 0.5765
±0.0012 |
