SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels

Matthias Fey, J. E. Lenssen, F. Weichert, H. Müller

Main figure for SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels

Abstract

We present Spline-based Convolutional Neural Networks (SplineCNNs), a variant of deep neural networks for irregular structured and geometric input,, graphs or meshes. Our main contribution is a novel convolution operator based on B-splines, that makes the computation time independent from the kernel size due to the local support property of the B-spline basis functions. As a result, we obtain a generalization of the traditional CNN convolution operator by using continuous kernel functions parametrized by a fixed number of trainable weights. In contrast to related approaches that filter in the spectral domain, the proposed method aggregates features purely in the spatial domain. In addition, SplineCNN allows entire end-to-end training of deep architectures, using only the geometric structure as input, instead of handcrafted feature descriptors. For validation, we apply our method on tasks from the fields of image graph classification, shape correspondence and graph node classification, and show that it outperforms or pars state-of-the-art approaches while being significantly faster and having favorable properties like domain-independence. Our source code is available on GitHub.

Proposed method: SplineCNN

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #136 115 places worse
0.8717 ±0.0058
actual #21 vs paper #136 115 places worse
paper 0.8717 ±0.0058
paper 0.8717 ±0.0058 Δ at pub 0.0558 Δ today 0.0287
31
SplineCNN
0.8948 ±0.0031
This paper
39
SAGE
0.8911 ±0.0012
105
CayleyNet
0.8790 ±0.0066
This paper
139
ChebNet
actual #139 vs paper #139
0.8712 ±0.0060
actual #139 vs paper #139
paper 0.8712 ±0.0060
paper 0.8712 ±0.0060 Δ at pub 0.0762
724
MLP
0.7768
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported value improved over the best known when published Improved at pub — later paper surpassed this result