Factorizable Graph Convolutional Networks
Abstract
Graphs have been widely adopted to denote structural connections between entities. The relations are in many cases heterogeneous, but entangled together and denoted merely as a single edge between a pair of nodes. For example, in a social network graph, users in different latent relationships like friends and colleagues, are usually connected via a bare edge that conceals such intrinsic connections. In this paper, we introduce a novel graph convolutional network (GCN), termed as factorizable graph convolutional network (FactorGCN), that explicitly disentangles such intertwined relations encoded in a graph. FactorGCN takes a simple graph as input, and disentangles it into several factorized graphs, each of which represents a latent and disentangled relation among nodes. The features of the nodes are then aggregated separately in each factorized latent space to produce disentangled features, which further leads to better performances for downstream tasks. We evaluate the proposed FactorGCN both qualitatively and quantitatively on the synthetic and real-world datasets, and demonstrate that it yields truly encouraging results in terms of both disentangling and feature aggregation. Code is publicly available at.
Benchmark Results
Tested on 3 datasets 2 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 best reported | best at pub: Provably Powerful Graph Networks (NeurIPS 2019) best today: ProtGNN: Towards Self-Explaining Graph Neural Networks (AAAI 2021) Difference within reported uncertainty; not counted as underperformance. |
| 54 | PatchySan | 0.9260
±0.0420 | This paper |
| 63 | GCN | 0.9220
±0.0440 best reported | best at pub: Graph Neural Networks With Convolutional ARMA Filters (2019) best today: Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery Curvature (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 167 | WL subtree | 0.9040
±0.0570 | This paper |
| 158 | GraphSAGE | 0.9040
±0.0780 best reported | best at pub: Graph Neural Networks With Convolutional ARMA Filters (2019) best today: Asynchronous Neural Networks for Learning in Graphs (2022) |
| 205 | FactorGCN | 0.8990
±0.0650 | This paper |
| 337 | AWL | 0.8790
±0.0980 | This paper |
| 403 | MLP | 0.8660
±0.0495 | |
| 718 | SAGE | 0.7490
±0.0870 |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 23 | GCN | 0.8260
±0.0220 best reported | best at pub: Fast Graph Representation Learning with PyTorch Geometric (ICLR 2019) best today: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) |
| 30 | GIN | 0.8220
±0.0210 best reported | best at pub: On the Equivalence between Graph Isomorphism Testing and Function Approximation with GNNs (NeurIPS 2019) best today: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) Difference within reported uncertainty; not counted as underperformance. |
| 73 | FactorGCN | 0.8120
±0.0140 | This paper |
| 136 | GraphSAGE | 0.7970
±0.0170 best reported | best at pub: Quaternion Graph Neural Networks (2020) |
| 137 | SAGE | 0.7970
±0.0170 | |
| 151 | MLP | 0.7920
±0.0240 | |
| 163 | WL subtree | 0.7890
±0.0190 | This paper |
| 268 | AWL | 0.7390
±0.0190 | This paper |
| 280 | PatchySan | 0.7260
±0.0220 | This paper |
GNNBenchmark
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | DeepGraph (48) | 0.9066
±0.0006 | |
| 2 | GRIT (our run) | 0.9041
±0.0023 | |
| 3 | GRIT 2-QiQRW | 0.9016
±0.0045 | |
| 60 | FactorGCN | 0.8657
±0.0002 | This paper |
| 66 | GatedGCN | 0.8651
±0.0008 best reported | best today: IJCAI--23 Formatting Instructions (IJCAI 2023) |
| 88 | GCN | 0.8561
±0.0003 best reported | best today: Recurrent Distance Filtering for Graph Representation Learning (ICML 2023) |
| 89 | GIN | 0.8559
±0.0001 | This paper |
| 91 | MoNet | 0.8558
±0.0004 best reported | |
| 105 | IPDGN | 0.7870
±0.0011 | This paper |
| 115 | DisenGCN | 0.7501
±0.0015 | This paper |
| 123 | MLP | 0.5052 | |
| 124 | GraphSAGE | 0.5052
±0.0000 |
