Propagation Kernels

Marion Neumann, Roman Garnett, Christian Bauckhage, Kristian Kersting

Main figure for Propagation Kernels

Abstract

We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data. Propagation kernels are based on monitoring how information spreads through a set of given graphs. They leverage early-stage distributions from propagation schemes such as random walks to capture structural information encoded in node labels, attributes, and edge information. This has two benefits. First, off-the-shelf propagation schemes can be used to naturally construct kernels for many graph types, including labeled, partially labeled, unlabeled, directed, and attributed graphs. Second, by leveraging existing efficient and informative propagation schemes, propagation kernels can be considerably faster than state-of-the-art approaches without sacrificing predictive performance. We will also show that if the graphs at hand have a regular structure, for instance when modeling image or video data, one can exploit this regularity to scale the kernel computation to large databases of graphs with thousands of nodes. We support our contributions by exhaustive experiments on a number of real-world graphs from a variety of application domains.

Benchmark Results

Tested on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
159
WL
actual #159 vs paper #484 325 places worse
0.9040 ±0.0570
best reported
actual #159 vs paper #484 325 places worse
paper 0.8400 ±0.0040

Difference within reported uncertainty; not counted as underperformance.

paper 0.8400 ±0.0040 Δ today 0.0640
403
MLP
0.8660 ±0.0495
426
SP
0.8580 ±0.0020
This paper
428
labels
0.8580 ±0.0020
This paper
441
gh
0.8540 ±0.0050
This paper
467
PK
0.8450 ±0.0060
This paper
469
propagation kernels
0.8450 ±0.0060
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9954
2
GIN
0.9934
3
GCN
0.9727
12
WL
0.8590 ±0.0010
This paper
32
propagation kernels
0.8450 ±0.0010
This paper
28
PK
0.8450 ±0.0010
This paper
131
GraphSAGE
0.8200 ±0.0100
421
SP
actual #421 vs paper #424 3 places worse
0.7450 ±0.0030
best reported
actual #421 vs paper #424 3 places worse
paper 0.7440 ±0.0010

Difference within reported uncertainty; not counted as underperformance.

paper 0.7440 ±0.0010 Δ today 0.0010
447
gh
0.7320 ±0.0010
This paper
530
labels
0.6460
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers)