ICML 2024

A General Graph Spectral Wavelet Convolution via Chebyshev Order Decomposition

Nian Liu, Xiaoxin He, T. Laurent, Francesco Di Giovanni, Michael M. Bronstein, Xavier Bresson

Main figure for A General Graph Spectral Wavelet Convolution via Chebyshev Order Decomposition

Abstract

Spectral graph convolution, an important tool of data filtering on graphs, relies on two essential decisions: selecting spectral bases for signal transformation and parameterizing the kernel for frequency analysis. While recent techniques mainly focus on standard Fourier transform and vector-valued spectral functions, they fall short in flexibility to model signal distributions over large spatial ranges, and capacity of spectral function. In this paper, we present a novel wavelet-based graph convolution network, namely WaveGC, which integrates multi-resolution spectral bases and a matrix-valued filter kernel. Theoretically, we establish that WaveGC can effectively capture and decouple short-range and long-range information, providing superior filtering flexibility, surpassing existing graph wavelet neural networks. To instantiate WaveGC, we introduce a novel technique for learning general graph wavelets by separately combining odd and even terms of Chebyshev polynomials. This approach strictly satisfies wavelet admissibility criteria. Our numerical experiments showcase the consistent improvements in both short-range and long-range tasks. This underscores the effectiveness of the proposed model in handling different scenarios. Our code is available at https://github.com/liun-online/WaveGC.

Proposed method: WaveGC

Benchmark Results

Tested on 3 datasets 2 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
actual #2 vs paper #111 109 places worse
0.9669 ±0.0014
best reported
actual #2 vs paper #111 109 places worse
paper 0.9387 ±0.0011
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
8
GCN
actual #8 vs paper #254 246 places worse
0.9632 ±0.0008
best reported
actual #8 vs paper #254 246 places worse
paper 0.9270 ±0.0020
21
APPNP
actual #21 vs paper #86 65 places worse
0.9573 ±0.0012
best reported
actual #21 vs paper #86 65 places worse
paper 0.9432 ±0.0014
37
SGT
0.9537 ±0.0044
This paper
79
GWNN
actual #79 vs paper #79
0.9445 ±0.0045
actual #79 vs paper #79
paper 0.9445 ±0.0045
paper 0.9445 ±0.0045 Δ at pub 0.0595
83
DEFT
0.9435 ±0.0044
This paper
84
SEA-GWNN
0.9435 ±0.0050
This paper
85
UFGConvR
0.9434 ±0.0034
This paper
98
WaveNet
0.9409 ±0.0063
This paper
101
UFGConvS
0.9398 ±0.0059
This paper
145
WaveShrink-ChebNet
0.9354 ±0.0090
This paper
215
Scattering GCN
actual #215 vs paper #215
0.9307 ±0.0042
actual #215 vs paper #215
paper 0.9307 ±0.0042
paper 0.9307 ±0.0042 Δ at pub 0.1156
289
SGWT
0.9245 ±0.0062
This paper
335
Scattering
0.9210 ±0.0061
This paper
390
MLP
0.9128 ±0.0063
#ModelAccuracy ↑Paper
1
GraphTARIF
0.9461 ±0.0017
2
GCN
actual #2 vs paper #128 126 places worse
0.9412 ±0.0008
best reported
actual #2 vs paper #128 126 places worse
paper 0.8965 ±0.0052
paper 0.8965 ±0.0052 Δ at pub 0.0007 Δ today 0.0447
3
GAT
actual #3 vs paper #60 57 places worse
0.9398 ±0.0022
best reported
actual #3 vs paper #60 57 places worse
paper 0.9078 ±0.0013
8
SAGE
0.9351 ±0.0006
21
WaveGC
0.9226 ±0.0018
This paper
22
Matrix-valued
0.9226
This paper
25
WaveNet
0.9206 ±0.0033
This paper
40
DEFT
0.9163 ±0.0052
This paper
58
APPNP
actual #58 vs paper #86 28 places worse
0.9093 ±0.0018
best reported
actual #58 vs paper #86 28 places worse
paper 0.9018 ±0.0017
62
GWNN
0.9075 ±0.0059
This paper
106
Vector-valued
0.8996
This paper
113
SEA-GWNN
0.8988 ±0.0064
This paper
147
UFGConvR
0.8929 ±0.0046
This paper
168
Scattering GCN
actual #168 vs paper #168
0.8883 ±0.0044
actual #168 vs paper #168
paper 0.8883 ±0.0044
paper 0.8883 ±0.0044 Δ at pub 0.2014
176
UFGConvS
0.8868 ±0.0039
This paper
200
WaveShrink-ChebNet
0.8820 ±0.0065
This paper
298
Scattering
0.8568 ±0.0071
This paper
307
SGWT
0.8519 ±0.0059
This paper
320
MLP
0.8463

OGB

#ModelAccuracy ↑Paper
1
GIANT-XRT
0.7612 ±0.0016
2
GEGCN
0.7576 ±0.0064
3
AGDN
0.7522 ±0.0007
15
GAT
actual #15 vs paper #50 35 places worse
0.7182 ±0.0023
actual #15 vs paper #50 35 places worse
paper 0.7182 ±0.0023
paper 0.7182 ±0.0023 Δ at pub 0.0122 Δ today 0.0183
22
WaveGC
0.7301 ±0.0018
This paper
23
GCN
actual #23 vs paper #52 29 places worse
0.7300 ±0.0017
best reported
actual #23 vs paper #52 29 places worse
paper 0.7174 ±0.0029
25
GraphSAGE
0.7277 ±0.0016
27
SEA-GWNN
0.7264 ±0.0021
This paper
40
DEFT
0.7201 ±0.0020
This paper
45
UFGConvR
0.7197 ±0.0012
This paper
49
APPNP
actual #49 vs paper #49
0.7190 ±0.0025
actual #49 vs paper #49
paper 0.7190 ±0.0025

Improvement within reported uncertainty; not highlighted.

paper 0.7190 ±0.0025 Δ at pub 0.0093
65
WaveNet
0.7137 ±0.0014
This paper
71
Scattering GCN
0.7118 ±0.0076
This paper
72
GWNN
0.7113 ±0.0047
This paper
86
UFGConvS
0.7004 ±0.0022
This paper
89
SGWT
0.6908 ±0.0030
This paper
98
Scattering
0.6623 ±0.0019
This paper
107
MLP
0.5765 ±0.0012
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Improved at pub — later paper surpassed this result Best today — OK at publication; today's leaderboard best is elsewhere