Weisfeiler and Leman Go Infinite: Spectral and Combinatorial Pre-Colorings
Abstract
Graph isomorphism testing is usually approached via the comparison of graph invariants. Two popular alternatives that offer a good trade-off between expressive power and computational efficiency are combinatorial (i.e., obtained via the Weisfeiler-Leman (WL) test) and spectral invariants. While the exact power of the latter is still an open question, the former is regularly criticized for its limited power, when a standard configuration of uniform pre-coloring is used. This drawback hinders the applicability of Message Passing Graph Neural Networks (MPGNNs), whose expressive power is upper bounded by the WL test. Relaxing the assumption of uniform pre-coloring, we show that one can increase the expressive power of the WL test ad infinitum. Following that, we propose an efficient pre-coloring based on spectral features that provably increases the expressive power of the vanilla WL test. The above claims are accompanied by extensive synthetic and real data experiments. The code to reproduce our experiments is available at.
Benchmark Results
Tested on 8 datasets 16 baseline values reported too low Non-standard metric on 1 dataset
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 best reported | best at pub: SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels (2017) best today: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 39 | SAGE | 0.8911
±0.0012 | |
| 44 | GAT | 0.8897
±0.0014 best reported | best at pub: Learned Low Precision Graph Neural Networks (2020) |
| 141 | GraphSAGE | 0.8708
±0.0085 best reported | best at pub: The Impact of Global Structural Information in Graph Neural Networks Applications (2020) best today: Large Language Model Meets Graph Neural Network in Knowledge Distillation (AAAI 2024) |
| 165 | GIN | 0.8180
±0.0050 | prev best: Learning Conjoint Attentions for Graph Neural Nets (NeurIPS 2021) best today: Large Language Model Meets Graph Neural Network in Knowledge Distillation (AAAI 2024) Improvement within reported uncertainty; not highlighted. |
| 488 | SP-GCN | 0.8230
±0.0140 | This paper |
| 539 | SP-GIN | 0.8190
±0.0180 | This paper |
| 540 | SP-GraphSAGE | 0.8190
±0.0230 | This paper |
| 689 | SP-GAT | 0.7920
±0.0190 | This paper |
| 724 | MLP | 0.7768 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 35 | GAT | 0.8080
±0.0026 best reported | best at pub: Gophormer: Ego-Graph Transformer for Node Classification (2021) best today: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 44 | GCN | 0.8033
±0.0088 best reported | best at pub: Gophormer: Ego-Graph Transformer for Node Classification (2021) |
| 61 | GraphSAGE | 0.7923
±0.0053 best reported | best at pub: Gophormer: Ego-Graph Transformer for Node Classification (2021) |
| 259 | SAGE | 0.7361
±0.0190 | |
| 338 | SP-GraphSAGE | 0.7290
±0.0060 | This paper |
| 350 | MLP | 0.7289
±0.0010 | |
| 389 | GIN | 0.7250
±0.0080 best reported | best at pub: Towards Self-Explainable Graph Neural Network (2021) Difference within reported uncertainty; not counted as underperformance. |
| 428 | SP-GAT | 0.7230
±0.0150 | This paper |
| 447 | SP-GCN | 0.7210
±0.0080 | This paper |
| 529 | SP-GIN | 0.7130
±0.0060 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 18 | GCN | 0.9296
±0.0015 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 20 | GAT | 0.9233
±0.0018 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 116 | SAGE | 0.8881
±0.0015 | |
| 125 | GraphSAGE | 0.8864
±0.0030 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) best today: Non-backtracking Graph Neural Networks (TMLR 2023) |
| 157 | GIN | 0.8810 best reported | best at pub: Learning Conjoint Attentions for Graph Neural Nets (NeurIPS 2021) best today: UGSL: A Unified Framework for Benchmarking Graph Structure Learning (2023) |
| 210 | MLP | 0.8690
±0.0074 | |
| 385 | SP-GCN | 0.8080
±0.0040 | This paper |
| 386 | SP-GraphSAGE | 0.8080
±0.0050 | This paper |
| 411 | SP-GAT | 0.8040
±0.0070 | This paper |
| 615 | SP-GIN | 0.7880
±0.0070 | This paper |
PPI
Global leaderboard →Sorted by Accuracy. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | Cluster-GCN | 0.9936 | |
| 2 | GaAN | 0.9871 | |
| 3 | GeniePath | 0.9850 | |
| 5 | GAT | 0.9730 best reported | best at pub: Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks (KDD 2019) best today: Graph Self-Supervised Learning: A Survey (2021) |
| 6 | SP-GraphSAGE | 0.9600
±0.0010 | This paper |
| 7 | GraphSAGE | 0.9580
±0.0010 | |
| 8 | SP-GIN | 0.9140
±0.0020 | This paper |
| 9 | GIN | 0.9110
±0.0020 | This paper |
| 10 | SP-GCN | 0.8920
±0.0010 | This paper |
| 11 | GCN | 0.8880
±0.0010 | This paper |
| 14 | SP-GAT | 0.8070
±0.0030 | This paper |
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 63 | GCN | 0.9220
±0.0440 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery Curvature (KDD 2025) |
| 112 | SP-GIN | 0.9100
±0.0600 | This paper |
| 113 | SP-GCN | 0.9100
±0.0600 | This paper |
| 114 | SP-GraphSAGE | 0.9100
±0.0700 | This paper |
| 158 | GraphSAGE | 0.9040
±0.0780 best reported | best at pub: Graph Neural Networks With Convolutional ARMA Filters (2019) best today: Asynchronous Neural Networks for Learning in Graphs (2022) Difference within reported uncertainty; not counted as underperformance. |
| 183 | GAT | 0.9010
±0.0580 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: The Expressive Power of Graph Neural Networks: A Survey (2023) |
| 188 | SP-GAT | 0.9000
±0.0500 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 718 | SAGE | 0.7490
±0.0870 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 best reported | best at pub: Provably Powerful Graph Networks (NeurIPS 2019) best today: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 3 | GCN | 0.9727 best reported | best at pub: Hierarchical Graph Capsule Network (AAAI 2020) best today: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 4 | GAT | 0.8100
±0.0100 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) best today: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 130 | SP-GIN | 0.8200
±0.0100 | This paper |
| 131 | GraphSAGE | 0.8200
±0.0100 | prev best: Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernels (NeurIPS 2019) |
| 132 | SP-GraphSAGE | 0.8200
±0.0100 | This paper |
| 177 | SP-GCN | 0.8100
±0.0100 | This paper |
| 178 | SP-GAT | 0.8100
±0.0100 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 32 | GIN | 0.7880
±0.0410 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: Permutation-Invariant graph partitioning: How graph neural networks capture structural interactions? (2023) Difference within reported uncertainty; not counted as underperformance. |
| 49 | GAT | 0.7800
±0.0300 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosis (2023) Difference within reported uncertainty; not counted as underperformance. |
| 67 | SAGE | 0.7726
±0.0228 | |
| 147 | SP-GIN | 0.7600
±0.0300 | This paper |
| 148 | GCN | 0.7600
±0.0320 best reported | best at pub: GraphiT: Encoding Graph Structure in Transformers (2021) best today: Simplifying Graph Convolutional Networks with Redundancy-Free Neighbors (2025) Difference within reported uncertainty; not counted as underperformance. |
| 149 | MLP | 0.7600
±0.0320 | |
| 155 | GraphSAGE | 0.7590
±0.0320 best reported | best at pub: Graph Convolutional Networks with EigenPooling (KDD 2019) best today: Simplifying Graph Convolutional Networks with Redundancy-Free Neighbors (2025) Difference within reported uncertainty; not counted as underperformance. |
| 246 | SP-GCN | 0.7500
±0.0300 | This paper |
| 247 | SP-GAT | 0.7500
±0.0400 | This paper |
| 364 | SP-GraphSAGE | 0.7300
±0.0400 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 23 | GCN | 0.8260
±0.0220 best reported | best at pub: Fast Graph Representation Learning with PyTorch Geometric (ICLR 2019) best today: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) |
| 30 | GIN | 0.8220
±0.0210 best reported | best at pub: On the Equivalence between Graph Isomorphism Testing and Function Approximation with GNNs (NeurIPS 2019) best today: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) |
| 136 | GraphSAGE | 0.7970
±0.0170 best reported | best at pub: Quaternion Graph Neural Networks (2020) |
| 137 | SAGE | 0.7970
±0.0170 | |
| 151 | MLP | 0.7920
±0.0240 | |
| 155 | GAT | 0.7908
±0.0136 best reported | best at pub: Improving Subgraph Recognition with Variational Graph Information Bottleneck (2021) best today: Graph Structure Refinement with Energy-based Contrastive Learning (AAAI 2024) |
| 206 | SP-GIN | 0.7700
±0.0100 | This paper |
| 207 | SP-GCN | 0.7700
±0.0200 | This paper |
| 208 | SP-GraphSAGE | 0.7700
±0.0200 | This paper |
| 263 | SP-GAT | 0.7400
±0.0200 | This paper |
