ICLR 2018

RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space

Zhiqing Sun, Zhihong Deng, Jian-Yun Nie, Jian Tang

Main figure for RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space

Abstract

We study the problem of learning representations of entities and relations in knowledge graphs for predicting missing links. The success of such a task heavily relies on the ability of modeling and inferring the patterns of (or between) the relations. In this paper, we present a new approach for knowledge graph embedding called RotatE, which is able to model and infer various relation patterns including: symmetry/antisymmetry, inversion, and composition. Specifically, the RotatE model defines each relation as a rotation from the source entity to the target entity in the complex vector space. In addition, we propose a novel self-adversarial negative sampling technique for efficiently and effectively training the RotatE model. Experimental results on multiple benchmark knowledge graphs show that the proposed RotatE model is not only scalable, but also able to infer and model various relation patterns and significantly outperform existing state-of-the-art models for link prediction.

Benchmark Results

Tested on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Knowledge Graphs

#ModelMRR ↑Paper
1
FedSage
0.8426 ±0.0026
2
FED-PUB
0.8348 ±0.0025
3
FedAvg
0.8252 ±0.0023
7
GCN
0.8171 ±0.0030
62
RotatE
0.4770 ±0.0010
This paper
76
pRotatE
0.4620
This paper
79
DistMult
actual #79 vs paper #87 8 places worse
0.4550
best reported
actual #79 vs paper #87 8 places worse
paper 0.4300
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.4300 Δ today 0.0250
84
ComplEx
0.4400
This paper
89
ConvE
0.4300
This paper
100
TransE
actual #100 vs paper #101 1 place worse
0.2310
best reported
actual #100 vs paper #101 1 place worse
paper 0.2260
#ModelMRR ↑Paper
1
sum, Msg_r^3, f(t)=0
0.8500
2
sum, Msg_r^3, f(t)=t
0.8440
3
PNA, Msg_r^1, f(t)=0
0.8010
33
DistMult
actual #33 vs paper #92 59 places worse
0.3580
best reported
actual #33 vs paper #92 59 places worse
paper 0.2410
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.2410 Δ today 0.1170
58
RotatE
0.3380
This paper
70
pRotatE
0.3280
This paper
71
ConvE
0.3250
This paper
#ModelMRR ↑Paper
1
Inverse Model
0.9630
2
RotatE
0.9490
This paper
3
ConvE
0.9430
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere