IJCAI 2019

SPAGAN: Shortest Path Graph Attention Network

Yiding Yang, Xinchao Wang, Mingli Song, Junsong Yuan, D. Tao

Main figure for SPAGAN: Shortest Path Graph Attention Network

Abstract

Graph convolutional networks (GCN) have recently demonstrated their potential in analyzing non-grid structure data that can be represented as graphs. The core idea is to encode the local topology of a graph, via convolutions, into the feature of a center node. In this paper, we propose a novel GCN model, which we term as Shortest Path Graph Attention Network (SPAGAN). Unlike conventional GCN models that carry out node-based attentions within each layer, the proposed SPAGAN conducts path-based attention that explicitly accounts for the influence of a sequence of nodes yielding the minimum cost, or shortest path, between the center node and its higher-order neighbors. SPAGAN therefore allows for a more informative and intact exploration of the graph structure and further a more effective aggregation of information from distant neighbors into the center node, as compared to node-based GCN methods. We test SPAGAN on the downstream classification task on several standard datasets, and achieve performances superior to the state of the art. Code is publicly available at.

Proposed method: SPAGAN

Benchmark Results

Tested on 3 datasets 3 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #573 552 places worse
0.9004
best reported
actual #21 vs paper #573 552 places worse
paper 0.8150
paper 0.8150 Δ at pub 0.0567 Δ today 0.0854
39
SAGE
0.8911 ±0.0012
44
GAT
actual #44 vs paper #424 380 places worse
0.8897 ±0.0014
best reported
actual #44 vs paper #424 380 places worse
paper 0.8300 ±0.0070
341
SPAGAN
0.8360 ±0.0050
This paper
435
DeepWalk
actual #435 vs paper #843 408 places worse
0.8290
best reported
actual #435 vs paper #843 408 places worse
paper 0.6720
508
MoNet
actual #508 vs paper #558 50 places worse
0.8220 ±0.0070
best reported
actual #508 vs paper #558 50 places worse
paper 0.8170 ±0.0050
best at pub: Graph Attention Networks (ICLR 2017)
best today: GRAND: Graph Neural Diffusion (ICML 2021)

Difference within reported uncertainty; not counted as underperformance.

paper 0.8170 ±0.0050 Δ today 0.0050
590
Chebyshev
0.8120
This paper
591
GAT^3
0.8120 ±0.0060
This paper
724
MLP
actual #724 vs paper #890 166 places worse
0.7768
best reported
actual #724 vs paper #890 166 places worse
paper 0.5510
best at pub: Graph Attention Networks (ICLR 2017)
paper 0.5510 Δ today 0.2258
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
35
GAT
actual #35 vs paper #388 353 places worse
0.8080 ±0.0026
best reported
actual #35 vs paper #388 353 places worse
paper 0.7250 ±0.0070
paper 0.7250 ±0.0070 Δ today 0.0830
44
GCN
actual #44 vs paper #603 559 places worse
0.8033 ±0.0088
best reported
actual #44 vs paper #603 559 places worse
paper 0.7030
61
GraphSAGE
0.7923 ±0.0053
331
SPAGAN
0.7300 ±0.0040
This paper
350
MLP
actual #350 vs paper #872 522 places worse
0.7289 ±0.0010
best reported
actual #350 vs paper #872 522 places worse
paper 0.4650
paper 0.4650 Δ at pub 0.0860 Δ today 0.2639
617
Chebyshev
actual #617 vs paper #630 13 places worse
0.7010 ±0.0080
best reported
actual #617 vs paper #630 13 places worse
paper 0.6980

Difference within reported uncertainty; not counted as underperformance.

paper 0.6980 Δ at pub 0.0030
661
GAT^3
0.6880 ±0.0070
This paper
692
DeepWalk
actual #692 vs paper #883 191 places worse
0.6785 ±0.0079
best reported
actual #692 vs paper #883 191 places worse
paper 0.4320
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
actual #18 vs paper #585 567 places worse
0.9296 ±0.0015
best reported
actual #18 vs paper #585 567 places worse
paper 0.7900
20
GAT
actual #20 vs paper #585 565 places worse
0.9233 ±0.0018
best reported
actual #20 vs paper #585 565 places worse
paper 0.7900 ±0.0030
116
SAGE
0.8881 ±0.0015
210
MLP
actual #210 vs paper #827 617 places worse
0.8690 ±0.0074
best reported
actual #210 vs paper #827 617 places worse
paper 0.7140
best at pub: Graph Attention Networks (ICLR 2017)
paper 0.7140 Δ today 0.1550
223
DeepWalk
actual #223 vs paper #861 638 places worse
0.8652 ±0.0012
best reported
actual #223 vs paper #861 638 places worse
paper 0.6530
446
MoNet
actual #446 vs paper #614 168 places worse
0.8006 ±0.0055
best reported
actual #446 vs paper #614 168 places worse
paper 0.7880 ±0.0030
498
SPAGAN
0.7960 ±0.0040
This paper
635
GeniePath
0.7850
This paper
639
GAT^3
0.7850 ±0.0040
This paper
807
Chebyshev
0.7440
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere