SoftEdge: Regularizing Graph Classification with Random Soft Edges
Abstract
Augmented graphs play a vital role in regularizing Graph Neural Networks (GNNs), which leverage information exchange along edges in graphs, in the form of message passing, for learning. Due to their effectiveness, simple edge and node manipulations (e.g., addition and deletion) have been widely used in graph augmentation. Nevertheless, such common augmentation techniques can dramatically change the semantics of the original graph, causing overaggressive augmentation and thus under-fitting in the GNN learning. To address this problem arising from dropping or adding graph edges and nodes, we propose SoftEdge, which assigns random weights to a portion of the edges of a given graph for augmentation. The synthetic graph generated by SoftEdge maintains the same nodes and their connectivities as the original graph, thus mitigating the semantic changes of the original graph. We empirically show that this simple method obtains superior accuracy to popular node and edge manipulation approaches and notable resilience to the accuracy degradation with the GNN depth.
Benchmark Results
Tested on 4 datasets 3 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) |
| 63 | GCN | 0.9220
±0.0440 | |
| 116 | DropEdge | 0.8780 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 286 | SoftEdge | 0.8890 | This paper |
| 363 | DropNode | 0.8750 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 403 | MLP | 0.8660
±0.0495 | |
| 461 | ResGCN | 0.8460 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9954 | |
| 2 | GIN | 0.9934 best reported | best at pub: 1-WL Expressiveness Is (Almost) All You Need (2022) |
| 3 | GCN | 0.9727 | |
| 40 | SoftEdge | 0.8390
±0.0010 | This paper |
| 111 | DropNode | 0.8240 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 117 | DropEdge | 0.8230
±0.0010 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 131 | GraphSAGE | 0.8200
±0.0100 | |
| 158 | ResGCN | 0.8140
±0.0030 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9410
±0.0330 | |
| 2 | GRDL | 0.8260
±0.0120 | |
| 3 | GMN | 0.8225 | |
| 32 | GIN | 0.7880
±0.0410 best reported | best at pub: Breaking the Limits of Message Passing Graph Neural Networks (ICML 2021) best today: Permutation-Invariant graph partitioning: How graph neural networks capture structural interactions? (2023) Difference within reported uncertainty; not counted as underperformance. |
| 67 | SAGE | 0.7726
±0.0228 | |
| 149 | MLP | 0.7600
±0.0320 | |
| 177 | SoftEdge | 0.7570
±0.0030 | This paper |
| 193 | DropEdge | 0.7550
±0.0020 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 233 | ResGCN | 0.7511
±0.0322 best reported | best today: Search to Capture Long-range Dependency with Stacking GNNs for Graph Classification (WWW 2023) Difference within reported uncertainty; not counted as underperformance. |
| 234 | DropNode | 0.7511
±0.0300 best reported | best at pub: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) best today: Fused Gromov-Wasserstein Graph Mixup for Graph-level Classifications (NeurIPS 2023) Difference within reported uncertainty; not counted as underperformance. |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GMN | 0.7866 | |
| 2 | MemGNN | 0.7550 | |
| 3 | TFGW SP | 0.7510
±0.0500 | |
| 17 | GatedGCN | 0.7000
±0.0494 | |
| 26 | GraphSAGE | 0.6817
±0.0545 | |
| 32 | GIN | 0.6767
±0.0583 best reported | best at pub: GraphCrop: Subgraph Cropping for Graph Classification (2020) best today: GNNBenchmark (JMLR 2023) |
| 78 | SoftEdge | 0.6150
±0.0040 | This paper |
| 99 | DropEdge | 0.5970
±0.0020 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 108 | DropNode | 0.5900
±0.0040 | prev best: ifMixup: Interpolating Graph Pair to Regularize Graph Classification (AAAI 2021) |
| 124 | MLP | 0.5583
±0.0352 | |
| 140 | ResGCN | 0.5410
±0.0140 | This paper |
