Quaternion Graph Neural Networks
Abstract
Recently, graph neural networks (GNNs) have become an important and active research direction in deep learning. It is worth noting that most of the existing GNN-based methods learn graph representations within the Euclidean vector space. Beyond the Euclidean space, learning representation and embeddings in hyper-complex space have also shown to be a promising and effective approach. To this end, we propose Quaternion Graph Neural Networks (QGNN) to learn graph representations within the Quaternion space. As demonstrated, the Quaternion space, a hyper-complex vector space, provides highly meaningful computations and analogical calculus through Hamilton product compared to the Euclidean and complex vector spaces. Our QGNN obtains state-of-the-art results on a range of benchmark datasets for graph classification and node classification. Besides, regarding knowledge graphs, our QGNN-based embedding model achieves state-of-the-art results on three new and challenging benchmark datasets for knowledge graph completion. Our code is available at:.
Benchmark Results
Tested on 2 datasets
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 | |
| 51 | PSCN | 0.9263
±0.0421 | This paper |
| 58 | QGNN | 0.9259
±0.0359 | This paper |
| 63 | GCN | 0.9220
±0.0440 best reported | best at pub: Graph Neural Networks With Convolutional ARMA Filters (2019) best today: Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery Curvature (KDD 2025) Difference within reported uncertainty; not counted as underperformance. |
| 130 | GFN | 0.9084
±0.0722 | This paper |
| 140 | PPGN | 0.9060
±0.0870 best reported | best today: The Expressive Power of Graph Neural Networks: A Survey (2023) Difference within reported uncertainty; not counted as underperformance. |
| 158 | GraphSAGE | 0.9040
±0.0780 best reported | best at pub: Graph Neural Networks With Convolutional ARMA Filters (2019) best today: Asynchronous Neural Networks for Learning in Graphs (2022) Difference within reported uncertainty; not counted as underperformance. |
| 183 | GAT | 0.8940
±0.0610 | prev best: Graph Neural Networks With Convolutional ARMA Filters (2019) Improvement within reported uncertainty; not highlighted. |
| 238 | GIN-0 | 0.8940
±0.0560 | prev best: Fast Graph Representation Learning with PyTorch Geometric (ICLR 2019) Improvement within reported uncertainty; not highlighted. |
| 301 | CapsGNN | 0.8867
±0.0688 best reported | best today: Towards Better Graph Representation Learning with Parameterized Decomposition & Filtering (ICML 2023) Difference within reported uncertainty; not counted as underperformance. |
| 403 | MLP | 0.8660
±0.0495 | |
| 425 | DGCNN | 0.8583
±0.0166 | This paper |
| 460 | IEGN | 0.8461
±0.1000 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | WL-MLP | 0.9792 | |
| 2 | MSH-GNN | 0.9640
±0.0070 | |
| 3 | CoCN | 0.8722
±0.0013 | |
| 23 | GCN | 0.8260
±0.0220 best reported | best at pub: Fast Graph Representation Learning with PyTorch Geometric (ICLR 2019) best today: Scalable Expressiveness through Preprocessed Graph Perturbations (2024) |
| 30 | GIN | 0.8220
±0.0210 | |
| 49 | GFN | 0.8150
±0.0242 | This paper |
| 64 | PPGN | 0.8138
±0.0142 | This paper |
| 66 | QGNN | 0.8136
±0.0131 | This paper |
| 112 | GIN-0 | 0.8020
±0.0190 | prev best: Fast Graph Representation Learning with PyTorch Geometric (ICLR 2019) Improvement within reported uncertainty; not highlighted. |
| 136 | GraphSAGE | 0.7970
±0.0170 | prev best: Wasserstein Embedding for Graph Learning (ICLR 2020) |
| 140 | CapsGNN | 0.7962
±0.0091 | prev best: Wasserstein Embedding for Graph Learning (ICLR 2020) Improvement within reported uncertainty; not highlighted. |
| 151 | MLP | 0.7920
±0.0240 | |
| 155 | GAT | 0.7908
±0.0136 best reported | best today: Graph Structure Refinement with Energy-based Contrastive Learning (AAAI 2024) |
| 179 | IEGN | 0.7792
±0.0170 | This paper |
| 186 | GCAPS | 0.7771
±0.0251 | This paper |
| 191 | DGCNN | 0.7759
±0.0224 best reported | best at pub: Graph U-Nets (2019) best today: Explainable Graph Representation Learning via Graph Pattern Analysis (IJCAI 2025) |
| 281 | PSCN | 0.7260
±0.0215 | This paper |
