Wasserstein Weisfeiler-Lehman Graph Kernels
Abstract
Most graph kernels are an instance of the class of $ $-Convolution kernels, which measure the similarity of objects by comparing their substructures. Despite their empirical success, most graph kernels use a naive aggregation of the final set of substructures, usually a sum or average, thereby potentially discarding valuable information about the distribution of individual components. Furthermore, only a limited instance of these approaches can be extended to continuously attributed graphs. We propose a novel method that relies on the Wasserstein distance between the node feature vector distributions of two graphs, which allows finding subtler differences in data sets by considering graphs as high-dimensional objects rather than simple means. We further propose a Weisfeiler--Lehman-inspired embedding scheme for graphs with continuous node attributes and weighted edges, enhance it with the computed Wasserstein distance, and thereby improve the state-of-the-art prediction performance on several graph classification tasks.
Benchmark Results
Tested on 5 datasets 11 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 | |
| 159 | WL | 0.9040
±0.0570 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) best today: How Powerful are $K$-hop Message Passing Graph Neural Networks (NeurIPS 2022) Difference within reported uncertainty; not counted as underperformance. |
| 372 | Weisfeiler--Lehman-inspired embedding scheme | 0.8727
±0.0150 | This paper |
| 388 | WL-OA | 0.8715
±0.0182 | prev best: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 403 | MLP | 0.8660
±0.0495 | |
| 439 | V | 0.8540
±0.0070 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) Difference within reported uncertainty; not counted as underperformance. |
| 445 | E | 0.8520
±0.0060 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 | |
| 3 | GCN | 0.9727 | |
| 8 | WL-OA | 0.8610
±0.0020 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) best today: Graph Self-Supervised Learning with Learnable Structural and Positional Encodings (WWW 2025) Difference within reported uncertainty; not counted as underperformance. |
| 12 | WL | 0.8590
±0.0010 best reported | best at pub: Propagation Kernels (2014) Difference within reported uncertainty; not counted as underperformance. |
| 14 | Weisfeiler--Lehman-inspired embedding scheme | 0.8575
±0.0025 | This paper |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 517 | E | 0.6620
±0.0010 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 529 | V | 0.6460
±0.0010 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 32 | GIN | 0.7880
±0.0410 | |
| 117 | WL-OA | 0.7640
±0.0040 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) Difference within reported uncertainty; not counted as underperformance. |
| 149 | MLP | 0.7600
±0.0320 | |
| 190 | WL | 0.7560
±0.0040 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 342 | E | 0.7350
±0.0020 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 381 | V | 0.7212
±0.0019 | prev best: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) best today: Understanding Isomorphism Bias in Graph Data Sets (2019) |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GMN | 0.7866 | |
| 2 | MemGNN | 0.7550 | |
| 3 | TFGW SP | 0.7510
±0.0500 | |
| 7 | WWL | 0.7325
±0.0087 | This paper |
| 17 | GatedGCN | 0.7000
±0.0494 | |
| 18 | WL | 0.6950
±0.0320 best reported | best at pub: Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs (2017) best today: Template based Graph Neural Network with Optimal Transport Distances (NeurIPS 2022) |
| 21 | RBF-WL | 0.6843
±0.0147 | This paper |
| 26 | GraphSAGE | 0.6817
±0.0545 | |
| 38 | HGK-SP | 0.6636
±0.0037 | This paper |
| 46 | gh | 0.6565
±0.0080 | This paper |
| 66 | HGK-WL | 0.6304
±0.0065 | This paper |
| 98 | WL-OA | 0.5990
±0.0110 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 124 | MLP | 0.5583
±0.0352 | |
| 167 | VH-C | 0.4715
±0.0079 | This paper |
| 244 | E | 0.2740
±0.0080 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 261 | V | 0.2340
±0.0110 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GC-GNN (GCN) | 0.9210
±0.0810 | |
| 2 | SUGAR | 0.8403
±0.0133 | |
| 3 | Ortho-g-U-Nets | 0.8387 | |
| 15 | SAGE | 0.8088
±0.0233 | |
| 25 | WL | 0.7978
±0.0036 best reported | best at pub: Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs (2017) best today: Graph Learning with Distributional Edge Layouts (2024) |
| 28 | WWL | 0.7969
±0.0050 | This paper |
| 40 | WL-OA | 0.7920
±0.0040 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) Difference within reported uncertainty; not counted as underperformance. |
| 67 | E | 0.7830
±0.0050 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) |
| 68 | V | 0.7824
±0.0028 | prev best: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) Improvement within reported uncertainty; not highlighted. |
