Position: Don't be Afraid of Over-Smoothing And Over-Squashing
Abstract
Over-smoothing and over-squashing have been extensively studied in the literature on Graph Neural Networks (GNNs) over the past years. We challenge this prevailing focus in GNN research, arguing that these phenomena are less critical for practical applications than assumed. We suggest that performance decreases often stem from uninformative receptive fields rather than over-smoothing. We support this position with extensive experiments on several standard benchmark datasets, demonstrating that accuracy and over-smoothing are mostly uncorrelated and that optimal model depths remain small even with mitigation techniques, thus highlighting the negligible role of over-smoothing. Similarly, we challenge that over-squashing is always detrimental in practical applications. Instead, we posit that the distribution of relevant information over the graph frequently factorises and is often localised within a small k-hop neighbourhood, questioning the necessity of jointly observing entire receptive fields or engaging in an extensive search for long-range interactions. The results of our experiments show that architectural interventions designed to mitigate over-squashing fail to yield significant performance gains. This position paper advocates for a paradigm shift in theoretical research, urging a diligent analysis of learning tasks and datasets using statistics that measure the underlying distribution of label-relevant information to better understand their localisation and factorisation.
Benchmark Results
Tested on 8 datasets 10 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 best reported | best at pub: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 39 | SAGE | 0.8911
±0.0012 | |
| 45 | GCNII | 0.8893
±0.0137 best reported | best at pub: Language is All a Graph Needs (2023) best today: Large Language Model Meets Graph Neural Network in Knowledge Distillation (AAAI 2024) |
| 723 | EGP (GCN) | 0.7770
±0.0470 | This paper |
| 724 | MLP | 0.7768 | |
| 758 | GCN + SDRF | 0.7620
±0.0300 | This paper |
| 765 | G² | 0.7560
±0.0110 | This paper |
| 769 | GCN + BORF | 0.7540
±0.0030 | This paper |
| 820 | GCN + Pairnorm | 0.6960
±0.0550 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 36 | GCNII | 0.8076
±0.0030 best reported | best at pub: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 44 | GCN | 0.8033
±0.0088 best reported | best at pub: NTFormer: A Composite Node Tokenized Graph Transformer for Node Classification (2024) |
| 61 | GraphSAGE | 0.7923
±0.0053 | |
| 124 | G² | 0.7650
±0.0040 | This paper |
| 133 | GCN + SDRF | 0.7610
±0.0060 | This paper |
| 142 | GCN + BORF | 0.7590
±0.0050 | This paper |
| 150 | EGP (GCN) | 0.7570
±0.0060 | This paper |
| 350 | MLP | 0.7289
±0.0010 | |
| 678 | GCN + Pairnorm | 0.6830
±0.0160 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 18 | GCN | 0.9296
±0.0015 best reported | |
| 58 | GCNII | 0.9030
±0.0043 best reported | best at pub: Feature Transportation Improves Graph Neural Networks (AAAI 2023) |
| 116 | SAGE | 0.8881
±0.0015 | |
| 161 | GCN + Pairnorm | 0.8790
±0.0040 | This paper |
| 174 | GCN + BORF | 0.8770
±0.0040 | This paper |
| 175 | GCN + SDRF | 0.8770
±0.0030 | This paper |
| 182 | G² | 0.8760
±0.0110 | This paper |
| 202 | EGP (GCN) | 0.8710
±0.0040 | This paper |
| 210 | MLP | 0.8690
±0.0074 |
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 63 | GCN | 0.9220
±0.0440 | |
| 111 | EGP (GIN) | 0.9110
±0.0140 | This paper |
| 169 | GATv2 | 0.9040
±0.0430 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 158 | GraphSAGE | 0.9040
±0.0780 best reported | best at pub: Asynchronous Neural Networks for Learning in Graphs (2022) Difference within reported uncertainty; not counted as underperformance. |
| 234 | GIN + SDRF | 0.8950
±0.0260 | This paper |
| 328 | GIN + BORF | 0.8810
±0.0270 | This paper |
| 329 | GraphSAGE + SDRF | 0.8810
±0.0300 | This paper |
| 386 | GATv2 + SDRF | 0.8720
±0.0270 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 436 | GraphSAGE + BORF | 0.8560
±0.0240 | This paper |
| 534 | GATv2 + BORF | 0.8280
±0.0330 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GMN | 0.7866 | |
| 2 | MemGNN | 0.7550 | |
| 3 | TFGW SP | 0.7510
±0.0500 | |
| 17 | GatedGCN | 0.7000
±0.0494 | |
| 26 | GraphSAGE | 0.6817
±0.0545 | |
| 32 | GIN | 0.6767
±0.0583 best reported | best at pub: GNNBenchmark (JMLR 2023) |
| 110 | GIN + BORF | 0.5840
±0.0210 | This paper |
| 124 | MLP | 0.5583
±0.0352 | |
| 157 | GIN + SDRF | 0.5030
±0.0260 | This paper |
| 159 | EGP (GIN) | 0.5020
±0.0270 | This paper |
| 166 | GATv2 | 0.4770
±0.0210 best reported | best at pub: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 193 | GraphSAGE + SDRF | 0.3870
±0.0220 | This paper |
| 204 | GATv2 + BORF | 0.3740
±0.0410 | This paper |
| 210 | GATv2 + SDRF | 0.3530
±0.0310 | This paper |
| 226 | GraphSAGE + BORF | 0.3100
±0.0250 | This paper |
OGB
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GIANT-XRT | 0.7612
±0.0016 | |
| 2 | GEGCN | 0.7576
±0.0064 | |
| 3 | AGDN | 0.7522
±0.0007 | |
| 23 | GCN | 0.7300
±0.0017 best reported | |
| 25 | GraphSAGE | 0.7277
±0.0016 | |
| 107 | MLP | 0.5765
±0.0012 | |
| 108 | EGP (GCN) | 0.5760
±0.0030 | This paper |
LRGB
| # | Model | AP ↑ | Paper |
|---|---|---|---|
| 1 | S^2GCN | 0.7311
±0.0066 | |
| 2 | S4G | 0.7293
±0.0004 | |
| 3 | BuNN | 0.7276
±0.0065 | |
| 4 | GCN | 0.7261
±0.0011 | |
| 26 | GIN | 0.6070
±0.0100 | prev best: Graph Triple Attention Network: A Decoupled Perspective (2024) best today: From Message-Passing to Linearized Graph Sequence Models (2026) |
| 140 | GIN + BORF | 0.5970
±0.0060 | This paper |
| 161 | GIN + SDRF | 0.5520
±0.0080 | This paper |
| 180 | EGP (GIN) | 0.4290
±0.0060 | This paper |
| 181 | MLP | 0.4060
±0.0021 |
Heterophily Benchmark
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | Dir-Poly | 0.9451
±0.0022 | |
| 2 | D-CDE | 0.9387
±0.0041 | |
| 3 | LargeScaleNet | 0.9358
±0.0024 | |
| 26 | GraphSAGE | 0.9106
±0.0027 | |
| 77 | GCN | 0.8272
±0.0082 best reported | best at pub: HyperAggregation: Aggregating over Graph Edges with Hypernetworks (2024) |
| 135 | MLP | 0.6665
±0.0047 | |
| 143 | GCNII | 0.6510
±0.0060 | This paper |
| 158 | G²-GCN | 0.6290
±0.0290 | This paper |
| 197 | EGP (GCN) | 0.4190
±0.0020 | This paper |
| 198 | GCN + SDRF | 0.4160
±0.0070 | This paper |
| 199 | GCN + BORF | 0.4090
±0.0070 | This paper |
| 203 | GCN + Pairnorm | 0.3730
±0.0040 | This paper |
