Topology Adaptive Graph Convolutional Networks

Jian Du, Shanghang Zhang, Guanhang Wu, José M. F. Moura, S. Kar

Main figure for Topology Adaptive Graph Convolutional Networks

Abstract

Spectral graph convolutional neural networks (CNNs) require approximation to the convolution to alleviate the computational complexity, resulting in performance loss. This paper proposes the topology adaptive graph convolutional network (TAGCN), a novel graph convolutional network defined in the vertex domain. We provide a systematic way to design a set of fixed-size learnable filters to perform convolutions on graphs. The topologies of these filters are adaptive to the topology of the graph when they scan the graph to perform convolution. The TAGCN not only inherits the properties of convolutions in CNN for grid-structured data, but it is also consistent with convolution as defined in graph signal processing. Since no approximation to the convolution is needed, TAGCN exhibits better performance than existing spectral CNNs on a number of data sets and is also computationally simpler than other recent methods.

Proposed method: TAGCN

Benchmark Results

Tested on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #573 552 places worse
0.9004
best reported
actual #21 vs paper #573 552 places worse
paper 0.8150
paper 0.8150 Δ at pub 0.0009 Δ today 0.0854
39
SAGE
0.8911 ±0.0012
44
GAT
actual #44 vs paper #424 380 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #424 380 places worse
paper 0.8300 ±0.0070
139
ChebNet
actual #139 vs paper #674 535 places worse
0.8712 ±0.0060
best reported
actual #139 vs paper #674 535 places worse
paper 0.7950
157
DCNN
actual #157 vs paper #741 584 places worse
0.8680
best reported
actual #157 vs paper #741 584 places worse
paper 0.7680 ±0.0060
395
TAGCN
0.8330 ±0.0070
This paper
435
DeepWalk
actual #435 vs paper #843 408 places worse
0.8290
best reported
actual #435 vs paper #843 408 places worse
paper 0.6720
508
MoNet
actual #508 vs paper #566 58 places worse
0.8220 ±0.0070
best reported
actual #508 vs paper #566 58 places worse
paper 0.8169 ±0.0050
best today: GRAND: Graph Neural Diffusion (ICML 2021)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8169 ±0.0050 Δ today 0.0051
724
MLP
0.7768
762
Planetoid
0.7570
This paper
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
35
GAT
actual #35 vs paper #388 353 places worse
0.8080 ±0.0026
best reported
actual #35 vs paper #388 353 places worse
paper 0.7250 ±0.0070
paper 0.7250 ±0.0070 Δ today 0.0830
44
GCN
actual #44 vs paper #603 559 places worse
0.8033 ±0.0088
best reported
actual #44 vs paper #603 559 places worse
paper 0.7030
61
GraphSAGE
0.7923 ±0.0053
232
ChebNet
actual #232 vs paper #630 398 places worse
0.7399 ±0.0160
best reported
actual #232 vs paper #630 398 places worse
paper 0.6980
paper 0.6980 Δ today 0.0419
350
MLP
0.7289 ±0.0010
520
TAGCN
0.7140 ±0.0050
This paper
692
DeepWalk
actual #692 vs paper #883 191 places worse
0.6785 ±0.0079
best reported
actual #692 vs paper #883 191 places worse
paper 0.4320
paper 0.4320 Δ today 0.2465
782
Planetoid
0.6470
This paper
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
actual #18 vs paper #585 567 places worse
0.7900
actual #18 vs paper #585 567 places worse
paper 0.7900

Improvement within reported uncertainty; not highlighted.

paper 0.7900 Δ at pub 0.0028 Δ today 0.1396
20
GAT
actual #20 vs paper #585 565 places worse
0.9233 ±0.0018
best reported
actual #20 vs paper #585 565 places worse
paper 0.7900 ±0.0030
78
DCNN
actual #78 vs paper #817 739 places worse
0.8980
best reported
actual #78 vs paper #817 739 places worse
paper 0.7300 ±0.0050
116
SAGE
0.8881 ±0.0015
199
ChebNet
actual #199 vs paper #806 607 places worse
0.8718 ±0.0029
best reported
actual #199 vs paper #806 607 places worse
paper 0.7440
paper 0.7440 Δ today 0.1278
210
MLP
0.8690 ±0.0074
223
DeepWalk
actual #223 vs paper #861 638 places worse
0.8652 ±0.0012
best reported
actual #223 vs paper #861 638 places worse
paper 0.6530
366
TAGCN
0.8110 ±0.0040
This paper
446
MoNet
actual #446 vs paper #612 166 places worse
0.8006 ±0.0055
best reported
actual #446 vs paper #612 166 places worse
paper 0.7881 ±0.0040
727
Planetoid
0.7720
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere