Adversarial Graph Disentanglement with Component-specific Aggregation
Abstract
A real-world graph has a complex topological structure, which is often formed by the interaction of different latent factors. Disentanglement of these latent factors can effectively improve the robustness and expressiveness of the node representation of a graph. However, most existing methods lack consideration of the intrinsic differences in relations between nodes caused by factor entanglement. In this paper, we propose an dversarial isentangled raph onvolutional etwork (ADGCN) for disentangled graph representation learning. To begin with, we point out two aspects of graph disentanglement that need to be considered, i.e., micro-disentanglement and macro-disentanglement. For them, a component-specific aggregation approach is proposed to achieve micro-disentanglement by inferring latent components that caused the links between nodes. On the basis of micro-disentanglement, we further propose a macro-disentanglement adversarial regularizer to improve the separability among component distributions, thus restricting the interdependence among components. Additionally, to reveal the topological graph structure, a diversity-preserving node sampling approach is proposed, by which the graph structure can be progressively refined in a way of local structure awareness. The experimental results on various real-world graph data verify that our ADGCN obtains more favorable performance over currently available alternatives. The source codes of ADGCN are available at.
Benchmark Results
Tested on 3 datasets 13 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 best reported | best at pub: SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels (2017) best today: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 39 | SAGE | 0.8911
±0.0012 | |
| 44 | GAT | 0.8897
±0.0014 best reported | best at pub: Learned Low Precision Graph Neural Networks (2020) |
| 108 | APPNP | 0.8787 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) best today: Feature Transportation Improves Graph Neural Networks (AAAI 2023) |
| 139 | ChebNet | 0.8712
±0.0060 best reported | best at pub: SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels (2017) |
| 223 | SGC | 0.8509
±0.0648 best reported | best at pub: Learning Conjoint Attentions for Graph Neural Nets (NeurIPS 2021) |
| 256 | ADGCN-R | 0.8450
±0.0070 | This paper |
| 274 | ADGCN | 0.8430
±0.0060 | This paper |
| 288 | LGD-GCN | 0.8420
±0.0040 | This paper |
| 297 | IPGDN | 0.8410 | This paper |
| 335 | DisenGCN | 0.8370 best reported | best today: Disentangled Generative Graph Representation Learning (2024) Difference within reported uncertainty; not counted as underperformance. |
| 382 | AP-GCN | 0.8340
±0.0030 best reported | best today: ROD: Reception-aware Online Distillation for Sparse Graphs (KDD 2021) |
| 384 | ARMA | 0.8340
±0.0060 | prev best: Spectral Graph Attention Network with Fast Eigen-approximation (2020) Improvement within reported uncertainty; not highlighted. |
| 444 | DisGNN | 0.8280
±0.0090 | This paper |
| 463 | FactorGCN | 0.8260
±0.0100 | This paper |
| 513 | SGCN | 0.8220
±0.0080 | This paper |
| 724 | MLP | 0.6160
±0.0060 | prev best: Graph Attention Networks (ICLR 2017) best today: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 20 | APPNP | 0.8142
±0.0026 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) best today: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 35 | GAT | 0.8080
±0.0026 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) best today: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 44 | GCN | 0.8033
±0.0088 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 61 | GraphSAGE | 0.7923
±0.0053 | |
| 96 | SGC | 0.7765
±0.0012 best reported | best at pub: Deep Learning on Graphs: A Survey (2018) |
| 204 | ADGCN-R | 0.7450
±0.0080 | This paper |
| 214 | ADGCN | 0.7430
±0.0070 | This paper |
| 213 | LGD-GCN | 0.7430
±0.0030 | This paper |
| 231 | IPGDN | 0.7400 | This paper |
| 232 | ChebNet | 0.7399
±0.0160 best reported | best at pub: Topology Adaptive Graph Convolutional Networks (2017) best today: Non-backtracking Graph Neural Networks (TMLR 2023) |
| 267 | DisenGCN | 0.7360
±0.0080 | prev best: GraphMix: Improved Training of GNNs for Semi-Supervised Learning (2019) Improvement within reported uncertainty; not highlighted. |
| 271 | SGCN | 0.7360
±0.0090 | This paper |
| 289 | DisGNN | 0.7340
±0.0030 | This paper |
| 295 | AP-GCN | 0.7330
±0.0060 | This paper |
| 350 | MLP | 0.6100
±0.0100 | prev best: Fast Haar Transforms for Graph Neural Networks (2019) best today: Gumbel-MPNN: Graph Rewiring with Gumbel-Softmax (2025) |
| 390 | ARMA | 0.7250
±0.0040 | This paper |
| 444 | FactorGCN | 0.7220
±0.0090 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 17 | APPNP | 0.9355
±0.0060 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 18 | GCN | 0.9296
±0.0015 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 20 | GAT | 0.9233
±0.0018 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 116 | SAGE | 0.8881
±0.0015 | |
| 141 | SGC | 0.8832
±0.0055 best reported | best at pub: Learning Conjoint Attentions for Graph Neural Nets (NeurIPS 2021) |
| 199 | ChebNet | 0.7810
±0.0060 | prev best: Topology Adaptive Graph Convolutional Networks (2017) best today: Non-backtracking Graph Neural Networks (TMLR 2023) |
| 210 | MLP | 0.7420
±0.0070 | prev best: Graph Attention Networks (ICLR 2017) best today: On the Equivalence of Graph Convolution and Mixup (TMLR 2023) |
| 217 | ARMA | 0.8678
±0.0021 best reported | best at pub: Graph Neural Networks With Convolutional ARMA Filters (2019) |
| 362 | ADGCN | 0.8120
±0.0050 | This paper |
| 361 | IPGDN | 0.8120 | This paper |
| 406 | DisenGCN | 0.8050 best reported | best at pub: GraphMix: Improved Training of GNNs for Semi-Supervised Learning (2019) best today: Disentangled Generative Graph Representation Learning (2024) Difference within reported uncertainty; not counted as underperformance. |
| 416 | ADGCN-R | 0.8040
±0.0040 | This paper |
| 424 | SGCN | 0.8030
±0.0150 | This paper |
| 425 | DisGNN | 0.8030
±0.0020 | This paper |
| 444 | AP-GCN | 0.8010
±0.0070 | This paper |
| 537 | FactorGCN | 0.7940
±0.0110 | This paper |
