Improving Subgraph-GNNs via Edge-Level Ego-Network Encodings
Abstract
We present a novel edge-level ego-network encoding for learning on graphs that can boost Message Passing Graph Neural Networks (MP-GNNs) by providing additional node and edge features or extending message-passing formats. The proposed encoding is sufficient to distinguish Strongly Regular Graphs, a family of challenging 3-WL equivalent graphs. We show theoretically that such encoding is more expressive than node-based sub-graph MP-GNNs. In an empirical evaluation on four benchmarks with 10 graph datasets, our results match or improve previous baselines on expressivity, graph classification, graph regression, and proximity tasks---while reducing memory usage by 18.1x in certain real-world settings.
Benchmark Results
Tested on 1 dataset 1 baseline value reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
GNNBenchmark
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | RandAlign | 0.7942
±0.0007 | |
| 2 | differential encoding | 0.7907
±0.0027 | |
| 3 | PPGT | 0.7856
±0.0070 | |
| 44 | GIN-AK+ | 0.7239
±0.0038 | prev best: From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness (ICLR 2021) Improvement within reported uncertainty; not highlighted. |
| 62 | GatedGCN | 0.7133
±0.0039 | |
| 92 | GraphSAGE | 0.6690
±0.0020 | |
| 109 | GIN | 0.6510
±0.0050 best reported | best at pub: Beyond Low-pass Filtering: Graph Convolutional Networks with Automatic Filtering (2021) |
| 127 | GIN+ELENE | 0.5634
±0.0006 | This paper |
| 126 | MLP | 0.5634
±0.0018 |
