TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectors

Long Yu, Zhi-Ping Luo, Huan Liu, Deng Lin, Hongzhu Li, Yafeng Deng

Main figure for TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectors

Abstract

Translation-based knowledge graph embedding has been one of the most important branches for knowledge representation learning since TransE came out. Although many translation-based approaches have achieved some progress in recent years, the performance was still unsatisfactory. This paper proposes a novel knowledge graph embedding method named TripleRE with two versions. The first version of TripleRE creatively divide the relationship vector into three parts. The second version takes advantage of the concept of residual and achieves better performance. In addition, attempts on using NodePiece to encode entities achieved promising results in reducing the parametric size, and solved the problems of scalability. Experiments show that our approach achieved state-of-the-art performance on the large-scale knowledge graph dataset ogbl-wikikg2, and competitive performance on other datasets.

Benchmark Results

Tested on 4 datasets 3 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

OGB

#ModelMRR ↑Paper
1
InterHT + DigPiece
0.7293 ±0.0018
2
StarGraph + TripleRE'
0.7290
3
TripleRE + StarGraph
0.7201 ±0.0011
7
TripleRE + NodePiece
0.6582 ±0.0020
This paper
10
ComplEx-RP
0.6392 ±0.0045
This paper
15
TripleREv2
0.6045 ±0.0017
This paper
20
PairRE
actual #20 vs paper #25 5 places worse
0.5805
best reported
actual #20 vs paper #25 5 places worse
paper 0.5208 ±0.0027
21
TripleRE
0.5794 ±0.0020
This paper
23
NodePiece + AutoSF
0.5703 ±0.0035
This paper
25
AutoSF
0.5458 ±0.0052
This paper
29
TransE
actual #29 vs paper #32 3 places worse
0.4536 ±0.0030
best reported
actual #29 vs paper #32 3 places worse
paper 0.4256 ±0.0030
paper 0.4256 ±0.0030 Δ at pub 0.0280
30
RotatE
0.4332 ±0.0025
This paper
36
ComplEx
actual #36 vs paper #36
0.4028 ±0.0030
best reported
actual #36 vs paper #36
paper 0.4027 ±0.0027

Difference within reported uncertainty; not counted as underperformance.

paper 0.4027 ±0.0027 Δ at pub 0.0001
39
DistMult
0.3729 ±0.0045
This paper
#ModelMRR ↑Paper
1
PairRE+LRE
0.8360
2
NBFnet
0.8317
3
AutoSF
0.8309 ±0.0008
This paper
4
TripleREv2
0.8272 ±0.0007
This paper
5
TripleRE
0.8191 ±0.0014
This paper
6
PairRE
0.8164 ±0.0005
This paper
7
ComplEx
0.8095 ±0.0007
This paper
8
DistMult
0.8043 ±0.0003
This paper
9
RotatE
0.7989 ±0.0004
This paper
11
TransE
0.7452 ±0.0004
This paper

Knowledge Graphs

FB15k-237

Global leaderboard →

Default metric is MRR. The paper reports 9 values on MRR , 7 values on MR , 9 values on Hit@10 , 8 values on Hit@3 and 8 values on Hit@1 .

#ModelMRR ↑ defaultMR ↑Hit@10 ↑Hit@3 ↑Hit@1 ↑Paper
1
sum, Msg_r^3, f(t)=0
0.8500
————
2
sum, Msg_r^3, f(t)=t
0.8440
————
3
PNA, Msg_r^1, f(t)=0
0.8010
————
27
OTE
0.3610
best reported
—
0.5370
0.3880
0.2580
MR —
Hit@10 0.5370
Hit@3 0.3880
Hit@1 0.2580
paper 0.3510
paper 0.3510 Δ at pub 0.0100
29
GC-OTE
0.3610
—
0.5500
0.3960
0.2670
MR —
Hit@10 0.5500
Hit@3 0.3960
Hit@1 0.2670
This paper
33
DistMult
0.3580
best reported
254.0000
0.4190
0.2630
0.1550
MR 254.0000
Hit@10 0.4190
Hit@3 0.2630
Hit@1 0.1550
paper 0.2410
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.2410 Δ today 0.1170
43
TripleRE
0.3510
142.0000
0.5520
0.3920
0.2510
MR 142.0000
Hit@10 0.5520
Hit@3 0.3920
Hit@1 0.2510
This paper
42
PairRE
0.3510
160.0000
0.5440
0.3870
0.2560
MR 160.0000
Hit@10 0.5440
Hit@3 0.3870
Hit@1 0.2560
This paper
47
ComplEx
0.3460
best reported
339.0000
0.4280
0.2750
0.1580
MR 339.0000
Hit@10 0.4280
Hit@3 0.2750
Hit@1 0.1580
paper 0.2470
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.2470 Δ today 0.0990
58
RotatE
0.3380
177.0000
0.5330
0.3750
0.2410
MR 177.0000
Hit@10 0.5330
Hit@3 0.3750
Hit@1 0.2410
This paper
67
TransE
0.3300
best reported
357.0000
0.4650
——
MR 357.0000
Hit@10 0.4650
Hit@3 —
Hit@1 —
paper 0.2940
71
ConvE
0.3250
244.0000
0.5010
0.3560
0.2370
MR 244.0000
Hit@10 0.5010
Hit@3 0.3560
Hit@1 0.2370
This paper

WN18

Global leaderboard →

Default metric is MRR. The paper reports 2 values on MRR and 2 values on Hit@10 .

#ModelMRR ↑ defaultHit@10 ↑Paper
1
Inverse Model
0.9630
—
2
RotatE
0.9490 ± 0.0000
—
3
ConvE
0.9430
—
10
TripleRE
0.7725
0.9541
Hit@10 0.9541
This paper
11
TransAt
0.6446
0.9510
Hit@10 0.9510
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere