NeurIPS 2024

Weisfeiler and Leman Go Loopy: A New Hierarchy for Graph Representational Learning

Raffaele Paolino, Sohir Maskey, Pascal Welke, Gitta Kutyniok

Main figure for Weisfeiler and Leman Go Loopy: A New Hierarchy for Graph Representational Learning

Abstract

We introduce $r$-loopy Weisfeiler-Leman ($r$-$ $WL), a novel hierarchy of graph isomorphism tests and a corresponding GNN framework, $r$-$ $MPNN, that can count cycles up to length $r+2$. Most notably, we show that $r$-$ $WL can count homomorphisms of cactus graphs. This extends 1-WL, which can only count homomorphisms of trees and, in fact, we prove that $r$-$ $WL is incomparable to $k$-WL for any fixed $k$. We empirically validate the expressive and counting power of $r$-$ $MPNN on several synthetic datasets and demonstrate the scalability and strong performance on various real-world datasets, particularly on sparse graphs. Our code is available.

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

LRGB

#ModelAP ↑Paper
1
S^2GCN
0.7311 ±0.0066
2
S4G
0.7293 ±0.0004
3
BuNN
0.7276 ±0.0065
4
GCN
0.7261 ±0.0011
85
7-ℓGIN
0.6570 ±0.0060
This paper
181
MLP
0.4060 ±0.0021
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers)