TMLR 2023

Improving Subgraph-GNNs via Edge-Level Ego-Network Encodings

Nurudin Alvarez-Gonzalez, Andreas Kaltenbrunner, Vicencc G'omez

Main figure for Improving Subgraph-GNNs via Edge-Level Ego-Network Encodings

Abstract

We present a novel edge-level ego-network encoding for learning on graphs that can boost Message Passing Graph Neural Networks (MP-GNNs) by providing additional node and edge features or extending message-passing formats. The proposed encoding is sufficient to distinguish Strongly Regular Graphs, a family of challenging 3-WL equivalent graphs. We show theoretically that such encoding is more expressive than node-based sub-graph MP-GNNs. In an empirical evaluation on four benchmarks with 10 graph datasets, our results match or improve previous baselines on expressivity, graph classification, graph regression, and proximity tasks---while reducing memory usage by 18.1x in certain real-world settings.

Benchmark Results

Tested on 1 dataset 1 baseline value reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

GNNBenchmark

#ModelAccuracy ↑Paper
1
RandAlign
0.7942 ±0.0007
2
differential encoding
0.7907 ±0.0027
3
PPGT
0.7856 ±0.0070
44
GIN-AK+
actual #44 vs paper #44
0.7239 ±0.0038
actual #44 vs paper #44
paper 0.7239 ±0.0038

Improvement within reported uncertainty; not highlighted.

paper 0.7239 ±0.0038 Δ at pub 0.0020
62
GatedGCN
0.7133 ±0.0039
92
GraphSAGE
0.6690 ±0.0020
109
GIN
actual #109 vs paper #121 12 places worse
0.6510 ±0.0050
best reported
actual #109 vs paper #121 12 places worse
paper 0.5982 ±0.0033
paper 0.5982 ±0.0033 Δ at pub 0.0528
127
GIN+ELENE
0.5634 ±0.0006
This paper
126
MLP
0.5634 ±0.0018
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green)