Beyond Low-pass Filtering: Graph Convolutional Networks with Automatic Filtering

Zonghan Wu, Shirui Pan, Guodong Long, Jing Jiang, Chengqi Zhang

Main figure for Beyond Low-pass Filtering: Graph Convolutional Networks with Automatic Filtering

Abstract

Graph convolutional networks are becoming indispensable for deep learning from graph-structured data. Most of the existing graph convolutional networks share two big shortcomings. First, they are essentially low-pass filters, thus the potentially useful middle and high frequency band of graph signals are ignored. Second, the bandwidth of existing graph convolutional filters is fixed. Parameters of a graph convolutional filter only transform the graph inputs without changing the curvature of a graph convolutional filter function. In reality, we are uncertain about whether we should retain or cut off the frequency at a certain point unless we have expert domain knowledge. In this paper, we propose Automatic Graph Convolutional Networks (AutoGCN) to capture the full spectrum of graph signals and automatically update the bandwidth of graph convolutional filters. While it is based on graph spectral theory, our AutoGCN is also localized in space and has a spatial form. Experimental results show that AutoGCN achieves significant improvement over baseline methods which only work as low-pass filters.

Proposed method: AutoGCN

Benchmark Results

Tested on 3 datasets 1 baseline value reported too low Non-standard metric on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

GNNBenchmark

#ModelAccuracy ↑Paper
1
RandAlign
0.7942 ±0.0007
2
differential encoding
0.7907 ±0.0027
3
PPGT
0.7856 ±0.0070
62
GatedGCN
0.7133 ±0.0039
88
AutoGCN
0.6780 ±0.0020
This paper
89
ChebNet
0.6770 ±0.0040
This paper
92
GraphSAGE
0.6690 ±0.0020
This paper
101
GAT
actual #101 vs paper #115 14 places worse
0.6611 ±0.0098
best reported
actual #101 vs paper #115 14 places worse
paper 0.6320 ±0.0080
paper 0.6320 ±0.0080 Δ at pub 0.0291
103
MoNet
actual #103 vs paper #116 13 places worse
0.6591 ±0.0251
best reported
actual #103 vs paper #116 13 places worse
paper 0.6230 ±0.0030

Difference within reported uncertainty; not counted as underperformance.

paper 0.6230 ±0.0030 Δ today 0.0361
104
SAGE
0.6577 ±0.0031
109
GIN
0.6510 ±0.0050
This paper
124
GCN
actual #124 vs paper #129 5 places worse
0.5839 ±0.0073
best reported
actual #124 vs paper #129 5 places worse
paper 0.5510 ±0.0040
paper 0.5510 ±0.0040 Δ at pub 0.0061 Δ today 0.0329
126
MLP
actual #126 vs paper #131 5 places worse
0.5634 ±0.0018
best reported
actual #126 vs paper #131 5 places worse
paper 0.5360 ±0.0070
best today: GNNBenchmark (JMLR 2023)
paper 0.5360 ±0.0070 Δ today 0.0274
131
SGC
0.5420 ±0.0030
This paper
133
APGCN
0.5230 ±0.0090
This paper

CLUSTER

Global leaderboard →
Non-default metric. This paper reports ACC; the dataset default is Accuracy. Values below use ACC only.

Sorted by ACC. Highlighted rows are from other papers.

#ModelACC ↑Paper
1
AutoGCN
0.7410 ±0.0020
This paper
2
ChebNet
0.7340 ±0.0040
This paper
3
GAT
0.6750 ±0.0060
This paper
4
GraphSAGE
0.6660 ±0.0180
This paper
5
GIN
0.6630 ±0.0100
This paper
6
MoNet
0.6630 ±0.0090
This paper
7
GCN
0.6450 ±0.0070
This paper
8
SGC
0.4750 ±0.0010
This paper
9
APGCN
0.3450 ±0.0020
This paper
10
MLP
0.2230 ±0.0030
This paper

PATTERN

Global leaderboard →
Non-default metric. This paper reports ACC; the dataset default is Accuracy. Values below use ACC only.

Sorted by ACC. Highlighted rows are from other papers.

#ModelACC ↑Paper
1
APGCN
1.0000
This paper
2
MoNet
0.8640
This paper
3
GIN
0.8630
This paper
4
AutoGCN
0.8590
This paper
5
ChebNet
0.8570
This paper
6
GCN
0.8550
This paper
7
SGC
0.8350 ±0.0010
This paper
8
GAT
0.7800 ±0.0040
This paper
9
GraphSAGE
0.6630 ±0.0020
This paper
10
MLP
0.5050
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere