Propagation Kernels
Abstract
We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data. Propagation kernels are based on monitoring how information spreads through a set of given graphs. They leverage early-stage distributions from propagation schemes such as random walks to capture structural information encoded in node labels, attributes, and edge information. This has two benefits. First, off-the-shelf propagation schemes can be used to naturally construct kernels for many graph types, including labeled, partially labeled, unlabeled, directed, and attributed graphs. Second, by leveraging existing efficient and informative propagation schemes, propagation kernels can be considerably faster than state-of-the-art approaches without sacrificing predictive performance. We will also show that if the graphs at hand have a regular structure, for instance when modeling image or video data, one can exploit this regularity to scale the kernel computation to large databases of graphs with thousands of nodes. We support our contributions by exhaustive experiments on a number of real-world graphs from a variety of application domains.
Benchmark Results
Tested on 2 datasets
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 | |
| 159 | WL | 0.9040
±0.0570 best reported | best today: How Powerful are $K$-hop Message Passing Graph Neural Networks (NeurIPS 2022) Difference within reported uncertainty; not counted as underperformance. |
| 403 | MLP | 0.8660
±0.0495 | |
| 426 | SP | 0.8580
±0.0020 | This paper |
| 428 | labels | 0.8580
±0.0020 | This paper |
| 441 | gh | 0.8540
±0.0050 | This paper |
| 467 | PK | 0.8450
±0.0060 | This paper |
| 469 | propagation kernels | 0.8450
±0.0060 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 | |
| 3 | GCN | 0.9727 | |
| 12 | WL | 0.8590
±0.0010 | This paper |
| 32 | propagation kernels | 0.8450
±0.0010 | This paper |
| 28 | PK | 0.8450
±0.0010 | This paper |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 421 | SP | 0.7450
±0.0030 best reported | best today: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) Difference within reported uncertainty; not counted as underperformance. |
| 447 | gh | 0.7320
±0.0010 | This paper |
| 530 | labels | 0.6460 | This paper |
