Quaternion Graph Neural Networks

Dai Quoc Nguyen, Tu Dinh Nguyen, Dinh Phung

Main figure for Quaternion Graph Neural Networks

Abstract

Recently, graph neural networks (GNNs) have become an important and active research direction in deep learning. It is worth noting that most of the existing GNN-based methods learn graph representations within the Euclidean vector space. Beyond the Euclidean space, learning representation and embeddings in hyper-complex space have also shown to be a promising and effective approach. To this end, we propose Quaternion Graph Neural Networks (QGNN) to learn graph representations within the Quaternion space. As demonstrated, the Quaternion space, a hyper-complex vector space, provides highly meaningful computations and analogical calculus through Hamilton product compared to the Euclidean and complex vector spaces. Our QGNN obtains state-of-the-art results on a range of benchmark datasets for graph classification and node classification. Besides, regarding knowledge graphs, our QGNN-based embedding model achieves state-of-the-art results on three new and challenging benchmark datasets for knowledge graph completion. Our code is available at:.

Proposed method: QGNN

Benchmark Results

Tested on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
51
PSCN
0.9263 ±0.0421
This paper
58
QGNN
0.9259 ±0.0359
This paper
63
GCN
actual #63 vs paper #432 369 places worse
0.9220 ±0.0440
best reported
actual #63 vs paper #432 369 places worse
paper 0.8560 ±0.0580

Difference within reported uncertainty; not counted as underperformance.

paper 0.8560 ±0.0580 Δ at pub 0.0010 Δ today 0.0660
130
GFN
0.9084 ±0.0722
This paper
140
PPGN
actual #140 vs paper #142 2 places worse
0.9060 ±0.0870
best reported
actual #140 vs paper #142 2 places worse
paper 0.9055 ±0.0870

Difference within reported uncertainty; not counted as underperformance.

paper 0.9055 ±0.0870 Δ today 0.0005
158
GraphSAGE
actual #158 vs paper #623 465 places worse
0.9040 ±0.0780
best reported
actual #158 vs paper #623 465 places worse
paper 0.7980 ±0.1390

Difference within reported uncertainty; not counted as underperformance.

paper 0.7980 ±0.1390 Δ at pub 0.0590 Δ today 0.1060
183
GAT
actual #183 vs paper #237 54 places worse
0.8940 ±0.0610
actual #183 vs paper #237 54 places worse
paper 0.8940 ±0.0610

Improvement within reported uncertainty; not highlighted.

paper 0.8940 ±0.0610 Δ at pub 0.0210
238
GIN-0
actual #238 vs paper #238
0.8940 ±0.0560
actual #238 vs paper #238
paper 0.8940 ±0.0560

Improvement within reported uncertainty; not highlighted.

paper 0.8940 ±0.0560 Δ at pub 0.0370
301
CapsGNN
actual #301 vs paper #402 101 places worse
0.8867 ±0.0688
best reported
actual #301 vs paper #402 101 places worse
paper 0.8667 ±0.0688

Difference within reported uncertainty; not counted as underperformance.

paper 0.8667 ±0.0688 Δ today 0.0200
403
MLP
0.8660 ±0.0495
425
DGCNN
0.8583 ±0.0166
This paper
460
IEGN
0.8461 ±0.1000
This paper
#ModelAccuracy ↑Paper
1
WL-MLP
0.9792
2
MSH-GNN
0.9640 ±0.0070
3
CoCN
0.8722 ±0.0013
23
GCN
actual #23 vs paper #156 133 places worse
0.8260 ±0.0220
best reported
actual #23 vs paper #156 133 places worse
paper 0.7900 ±0.0180
paper 0.7900 ±0.0180 Δ at pub 0.0160 Δ today 0.0360
30
GIN
0.8220 ±0.0210
49
GFN
0.8150 ±0.0242
This paper
64
PPGN
0.8138 ±0.0142
This paper
66
QGNN
0.8136 ±0.0131
This paper
112
GIN-0
actual #112 vs paper #112
0.8020 ±0.0190
actual #112 vs paper #112
paper 0.8020 ±0.0190

Improvement within reported uncertainty; not highlighted.

paper 0.8020 ±0.0190 Δ at pub 0.0090
136
GraphSAGE
actual #136 vs paper #136
0.7970 ±0.0170
actual #136 vs paper #136
paper 0.7970 ±0.0170
paper 0.7970 ±0.0170 Δ at pub 0.0580
140
CapsGNN
actual #140 vs paper #140
0.7962 ±0.0091
actual #140 vs paper #140
paper 0.7962 ±0.0091

Improvement within reported uncertainty; not highlighted.

paper 0.7962 ±0.0091 Δ at pub 0.0002
151
MLP
0.7920 ±0.0240
155
GAT
actual #155 vs paper #234 79 places worse
0.7908 ±0.0136
best reported
actual #155 vs paper #234 79 places worse
paper 0.7580 ±0.0160
paper 0.7580 ±0.0160 Δ today 0.0328
179
IEGN
0.7792 ±0.0170
This paper
186
GCAPS
0.7771 ±0.0251
This paper
191
DGCNN
actual #191 vs paper #269 78 places worse
0.7759 ±0.0224
best reported
actual #191 vs paper #269 78 places worse
paper 0.7376 ±0.0049
best at pub: Graph U-Nets (2019)
paper 0.7376 ±0.0049 Δ today 0.0383
281
PSCN
0.7260 ±0.0215
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere