Search to aggregate neighborhood for graph neural network

Huan Zhao, Quanming Yao, Wei-Wei Tu

Main figure for Search to aggregate neighborhood for graph neural network

Abstract

Recent years have witnessed the popularity and success of graph neural networks (GNN) in various scenarios. To obtain data-specific GNN architectures, researchers turn to neural architecture search (NAS), which have made impressive success in discovering effective architectures in convolutional neural networks. However, it is non-trivial to apply NAS approaches to GNN due to challenges in search space design and expensive searching cost of existing NAS methods. In this work, to obtain the data-specific GNN architectures and address the computational challenges facing by NAS approaches, we propose a framework, which tries to Search to Aggregate NEighborhood (SANE), to automatically design data-specific GNN architectures. By designing a novel and expressive search space, we propose a differentiable search algorithm, which is more efficient than previous reinforcement learning based methods. Experimental results on four tasks and seven real-world datasets demonstrate the superiority of SANE compared to existing GNN models and NAS approaches in terms of effectiveness and efficiency.. Correspondence is to Q.Yao.

Proposed method: SANE

Benchmark Results

Tested on 1 dataset 4 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelF1 ↑Paper
1
GAMLP(JK)
0.9982 ±0.0001
2
GraphCON-GCN
0.9960
3
GCNII
0.9953 ±0.0001
20
SANE
0.9856 ±0.0120
This paper
21
GCN
actual #21 vs paper #141 120 places worse
0.9850
best reported
actual #21 vs paper #141 120 places worse
paper 0.6500
best today: Graph-Coupled Oscillator Networks (ICML 2022)
paper 0.6500 Δ at pub 0.1580 Δ today 0.3350
22
GeniePath
actual #22 vs paper #122 100 places worse
0.9850
best reported
actual #22 vs paper #122 100 places worse
paper 0.7138
best today: Graph-Coupled Oscillator Networks (ICML 2022)
paper 0.7138 Δ at pub 0.2712 Δ today 0.2712
55
GAT-JK
0.9749
This paper
57
GAT
actual #57 vs paper #83 26 places worse
0.9732 ±0.0032
best reported
actual #57 vs paper #83 26 places worse
paper 0.9414
67
GeniePath-JK
0.9694
This paper
77
Bayesian
0.9583 ±0.0082
This paper
81
Random
actual #81 vs paper #81
0.9517 ±0.0032
actual #81 vs paper #81
paper 0.9517 ±0.0032
paper 0.9517 ±0.0032 Δ at pub 0.5557
83
GIN-JK
0.9467
This paper
92
GIN
actual #92 vs paper #92
0.8724 ±0.0002
actual #92 vs paper #92
paper 0.8724 ±0.0002
paper 0.8724 ±0.0002 Δ at pub 0.0914
98
GCN-JK
0.8078
This paper
100
GraphSAGE-JK
0.8019
This paper
101
GraphSAGE
actual #101 vs paper #141 40 places worse
0.7860
best reported
actual #101 vs paper #141 40 places worse
paper 0.6504
paper 0.6504 Δ at pub 0.0496 Δ today 0.1356
103
LGCN
0.7720 ±0.0020
This paper
132
SAGE
0.6928
173
MLP
0.4620
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published