Beyond Low-Pass Filters: Adaptive Feature Propagation on Graphs

Sean Li, Dongwoo Kim, Qing Wang

Main figure for Beyond Low-Pass Filters: Adaptive Feature Propagation on Graphs

Abstract

Graph neural networks (GNNs) have been extensively studied for prediction tasks on graphs. As pointed out by recent studies, most GNNs assume local homophily, i.e., strong similarities in local neighborhoods. This assumption however limits the generalizability power of GNNs. To address this limitation, we propose a flexible GNN model, which is capable of handling any graphs without being restricted by their underlying homophily. At its core, this model adopts a node attention mechanism based on multiple learnable spectral filters; therefore, the aggregation scheme is learned adaptively for each graph in the spectral domain. We evaluated the proposed model on node classification tasks over eight benchmark datasets. The proposed model is shown to generalize well to both homophilic and heterophilic graphs. Further, it outperforms all state-of-the-art baselines on heterophilic graphs and performs comparably with them on homophilic graphs.

Benchmark Results

Tested on 3 datasets Non-standard metric on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterophilic Graphs

Texas

Global leaderboard →
Non-default metric. This paper reports Micro-F1; the dataset default is Accuracy. Values below use Micro-F1 only.

Sorted by Micro-F1. Highlighted rows are from other papers.

#ModelMicro-F1 ↑Paper
1
ASGAT-Cheb
0.8510 ±0.0570
This paper
2
GraphSAGE
0.8270 ±0.0480
This paper
3
H2GCN
0.8270 ±0.0570
This paper
5
Vanilla ASGAT
0.8220 ±0.0320
This paper
4
ARMANet
0.8220 ±0.0510
This paper
6
ChevNet
0.7970 ±0.0500
This paper
8
ASGAT-ARMA
0.7950 ±0.0770
This paper
7
APPNP
0.7950 ±0.0460
This paper
9
MLP
0.7920 ±0.0610
This paper
10
Geom-GCN
0.6760
This paper
11
GCN
0.6410 ±0.0490
This paper
12
GAT
0.6000 ±0.0570
This paper
13
SGC
0.5890 ±0.0610
This paper

Cornell

Global leaderboard →
Non-default metric. This paper reports Micro-F1; the dataset default is Accuracy. Values below use Micro-F1 only.

Sorted by Micro-F1. Highlighted rows are from other papers.

#ModelMicro-F1 ↑Paper
1
Vanilla ASGAT
0.8460 ±0.0580
This paper
2
ASGAT-ARMA
0.8320 ±0.0550
This paper
3
ASGAT-Cheb
0.8270 ±0.0830
This paper
4
H2GCN
0.8220 ±0.0600
This paper
5
MLP
0.8140 ±0.0630
This paper
6
ChevNet
0.7650 ±0.0940
This paper
7
ARMANet
0.7490 ±0.0290
This paper
8
APPNP
0.7030 ±0.0930
This paper
9
GraphSAGE
0.6730 ±0.0690
This paper
10
Geom-GCN
0.6080
This paper
11
GCN
0.5920 ±0.0320
This paper
12
GAT
0.5890 ±0.0330
This paper
13
SGC
0.5810 ±0.0460
This paper

Wisconsin

Global leaderboard →
Non-default metric. This paper reports Micro-F1; the dataset default is Accuracy. Values below use Micro-F1 only.

Sorted by Micro-F1. Highlighted rows are from other papers.

#ModelMicro-F1 ↑Paper
1
Vanilla ASGAT
0.8690 ±0.0420
This paper
2
H2GCN
0.8650 ±0.0440
This paper
3
ASGAT-Cheb
0.8630 ±0.0370
This paper
4
ASGAT-ARMA
0.8470 ±0.0440
This paper
5
MLP
0.8270 ±0.0450
This paper
6
ChevNet
0.8250 ±0.0280
This paper
7
APPNP
0.8120 ±0.0250
This paper
8
ARMANet
0.7840 ±0.0460
This paper
9
GraphSAGE
0.7760 ±0.0460
This paper
10
GCN
0.6410 ±0.0630
This paper
11
GAT
0.6200 ±0.0520
This paper
12
SGC
0.5180 ±0.0590
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper)