A Signed Graph Approach to Understanding and Mitigating Oversmoothing in GNNs
Abstract
Deep graph neural networks (GNNs) often suffer from oversmoothing, where node representations become overly homogeneous with increasing depth. While techniques like normalization, residual connections, and edge dropout have been proposed to mitigate oversmoothing, they are typically developed independently, with limited theoretical understanding of their underlying mechanisms. In this work, we present a unified theoretical perspective based on the framework of signed graphs, showing that many existing strategies implicitly introduce negative edges that alter message-passing to resist oversmoothing. However, we show that merely adding negative edges in an unstructured manner is insufficient—the asymptotic behavior of signed propagation depends critically on the strength and organization of positive and negative edges. To address this limitation, we leverage the theory of structural balance, which promotes stable, cluster-preserving dynamics by connecting similar nodes with positive edges and dissimilar ones with negative edges. We propose Structural Balanced Propagation (SBP), a plug-and-play method that assigns signed edges based on either labels or feature similarity to explicitly enhance structural balance in the constructed signed graphs. Experiments on nine benchmarks across both homophilic and heterophilic settings demonstrate that SBP consistently improves classification accuracy and mitigates oversmoothing, even at depths of up to 300 layers. Our results provide a principled explanation for prior oversmoothing remedies and introduce a new direction for signed message-passing design in deep GNNs.
Benchmark Results
Tested on 4 datasets 15 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
OGB
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | Jacobi | 0.8968 | |
| 2 | GPR | 0.8953 | |
| 3 | LEMP4HG | 0.8939 | |
| 4 | SAGE | 0.8933 | |
| 6 | GCN | 0.8868 best reported | best at pub: Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Trees (ICML 2024) |
| 235 | Label-SBP | 0.7662 | This paper |
| 271 | BatchNorm | 0.7493 | This paper |
| 274 | Feature-SBP | 0.7490 | This paper |
| 351 | MLP | 0.6605
±0.0020 |
Heterophilic Graphs
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | P^2GNN | 0.9672
±0.0147 | |
| 2 | DoG | 0.9660
±0.0210 | |
| 3 | GPF-plus | 0.9583
±0.0419 | |
| 34 | MLP | 0.9230
±0.0070 best reported | |
| 46 | APPNP | 0.9131
±0.0197 best reported | best at pub: A Quasi-Wasserstein Loss for Learning Graph Neural Networks (WWW 2023) |
| 53 | GraphSAGE | 0.9000
±0.0365 | |
| 271 | Feature-SBP | 0.7838 | This paper |
| 272 | Label-SBP | 0.7838 | This paper |
| 330 | SGC | 0.7440
±0.0600 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 386 | DAGNN | 0.7027
±0.0493 best reported | |
| 392 | JKNet | 0.7000
±0.0549 best reported | best at pub: Optimization-Induced Graph Implicit Nonlinear Diffusion (ICML 2022) best today: Bayesian Neighborhood Adaptation for Graph Neural Networks (TMLR 2025) |
| 432 | Residual | 0.6595
±0.0132 | This paper |
| 499 | PairNorm | 0.6030
±0.0430 best reported | best at pub: Graph-Coupled Oscillator Networks (ICML 2022) |
| 514 | DropEdge | 0.5946
±0.0811 | prev best: SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization (WWW 2023) Improvement within reported uncertainty; not highlighted. |
| 592 | ContraNorm | 0.4838
±0.0443 | This paper |
| 608 | BatchNorm | 0.3973
±0.0124 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | P^2GNN | 0.9541
±0.0272 | |
| 2 | ACM-GCN | 0.9480
±0.0380 | |
| 3 | RF-GCN | 0.9429 | |
| 21 | APPNP | 0.9181
±0.0196 best reported | best at pub: LON-GNN: Spectral GNNs with Learnable Orthonormal Basis (2023) |
| 24 | MLP | 0.9136
±0.0070 best reported | best at pub: Node-oriented Spectral Filtering for Graph Neural Networks (2022) |
| 138 | SAGE | 0.8269 | |
| 241 | JKNet | 0.7443
±0.0830 best reported | best at pub: Oversmoothing alleviation in graph neural networks: a survey and unified view (2024) best today: Bayesian Neighborhood Adaptation for Graph Neural Networks (TMLR 2025) |
| 250 | DAGNN | 0.7351
±0.0718 best reported | |
| 252 | SGC | 0.7350
±0.0430 best reported | best at pub: Restructuring Graphs for Higher Homophily via Adaptive Spectral Clustering (AAAI 2022) |
| 255 | Feature-SBP | 0.7297 | This paper |
| 284 | Label-SBP | 0.7027 | This paper |
| 359 | Residual | 0.6189
±0.0391 | This paper |
| 374 | DropEdge | 0.6054
±0.0530 best reported | best at pub: Graph Neural Networks with a Distribution of Parametrized Graphs (ICML 2023) |
| 389 | PairNorm | 0.5892
±0.0315 best reported | best at pub: Understanding convolution on graphs via energies (TMLR 2022) best today: Graph Navier–Stokes Networks (2026) |
| 501 | ContraNorm | 0.4863
±0.0016 | This paper |
| 520 | BatchNorm | 0.4649
±0.0108 | This paper |
Heterophily Benchmark
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | UniGAP | 0.6375
±0.0110 | |
| 2 | H2GCN + HalfHop | 0.5961
±0.0100 | |
| 3 | GraphSAGE + HalfHop | 0.5897
±0.0150 | |
| 12 | SAGE | 0.5569
±0.0023 | |
| 82 | SGC | 0.5066
±0.0048 best reported | best at pub: Scalable Graph Compressed Convolutions (2024) |
| 84 | MLP | 0.5058 best reported | best at pub: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 169 | ContraNorm | 0.4298
±0.0004 | This paper |
| 172 | Residual | 0.4269
±0.0003 | This paper |
| 174 | APPNP | 0.4247
±0.0003 | This paper |
| 175 | Label-SBP | 0.4241
±0.0002 | This paper |
| 176 | Feature-SBP | 0.4231
±0.0003 | This paper |
| 177 | PairNorm | 0.4230
±0.0005 | This paper |
| 178 | DropEdge | 0.4230
±0.0009 | This paper |
| 180 | JKNet | 0.4221
±0.0005 | This paper |
| 185 | DAGNN | 0.4061
±0.0003 | This paper |
| 189 | BatchNorm | 0.3968
±0.0001 | This paper |
