ICML 2016

Complex Embeddings for Simple Link Prediction

Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, Guillaume Bouchard

Main figure for Complex Embeddings for Simple Link Prediction

Abstract

In statistical relational learning, the link prediction problem is key to automatically understand the structure of large knowledge bases. As in previous studies, we propose to solve this problem through latent factorization. However, here we make use of complex valued embeddings. The composition of complex embeddings can handle a large variety of binary relations, among them symmetric and antisymmetric relations. Compared to state-of-the-art models such as Neural Tensor Network and Holographic Embeddings, our approach based on complex embeddings is arguably simpler, as it only uses the Hermitian dot product, the complex counterpart of the standard dot product between real vectors. Our approach is scalable to large datasets as it remains linear in both space and time, while consistently outperforming alternative approaches on standard link prediction benchmarks.

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Knowledge Graphs

#ModelMRR ↑Paper
1
Inverse Model
0.9630
2
RotatE
0.9490
3
ConvE
0.9430
6
HolE
0.9380
This paper
8
DistMult
0.8220
This paper
12
TransE
0.4540
This paper
13
CP
0.0750
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers)