Message Passing on the Edge: Towards Scalable and Expressive GNNs

P. Barcel'o, Fabian Jogl, A. Kozachinskiy, Matthias Lanzinger, S. Neumann, Cristóbal Rojas

Main figure for Message Passing on the Edge: Towards Scalable and Expressive GNNs

Abstract

Graph neural networks (GNNs) are widely used in graph learning and most architectures propagate information by passing messages between vertices. In this work, we shift our attention to GNNs that perform message passing on edges and introduce EB-1WL, an edge-based color-refinement test, and a corresponding architecture, EB-GNN. Our EB-GNN architecture is inspired by the classic triangle-counting algorithm of Chiba and Nishizeki and passes messages along edges and triangles. Our contributions are as follows: (1) Theoretically, we show that EB-1WL is significantly more expressive than 1WL. We provide a complete logical characterization of EB-1WL in first-order logic, along with distinguishability results via homomorphism counting. To the best of our knowledge, EB-GNN has the strongest theoretical expressivity guarantees among edge-based message-passing GNNs in the literature. (2) Unlike many GNN architectures that are more expressive than 1WL, we prove that EB-1WL and EB-GNN admit near-linear time and memory usage on practical graph learning workloads. (3) We show in experiments that EB-GNN is a highly efficient general-purpose architecture: it substantially outperforms simple MPNNs and remains competitive with task-specialized state-of-the-art GNNs at substantially lower computational cost.

Proposed method: EB-GNN

Benchmark Results

Tested on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

GNNBenchmark

#ModelAccuracy ↑Paper
1
PPGN
1.0000
2
RW-AgentNet
1.0000
3
AgentNet
1.0000
8
GCN
1.0000
57
4-ll-GIN
0.6000
This paper
68
EB-GNN
0.2000
This paper
66
MPNN + C_3
0.2000
This paper
67
NC-GNN
0.2000
This paper
78
MPNN
0.1000
This paper

Other Graph Benchmarks

#ModelAccuracy ↑Paper
1
GMN
0.9415 ±0.0020
2
DirGraphSSM
0.9409 ±0.0023
3
DAG+SAT-plus
0.9407 ±0.0020
9
EB-GNN
0.9330 ±0.0066
This paper
11
HyMN
0.9284 ±0.0052
This paper
15
NC-GNN
0.9250 ±0.0056
This paper
17
GPS (Perf.)
0.9214 ±0.0024
This paper
18
MPNN
0.9110 ±0.0098
This paper
22
GIN
0.8898 ±0.0055
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers)