TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectors
Abstract
Translation-based knowledge graph embedding has been one of the most important branches for knowledge representation learning since TransE came out. Although many translation-based approaches have achieved some progress in recent years, the performance was still unsatisfactory. This paper proposes a novel knowledge graph embedding method named TripleRE with two versions. The first version of TripleRE creatively divide the relationship vector into three parts. The second version takes advantage of the concept of residual and achieves better performance. In addition, attempts on using NodePiece to encode entities achieved promising results in reducing the parametric size, and solved the problems of scalability. Experiments show that our approach achieved state-of-the-art performance on the large-scale knowledge graph dataset ogbl-wikikg2, and competitive performance on other datasets.
Benchmark Results
Tested on 4 datasets 3 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
OGB
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | InterHT + DigPiece | 0.7293
±0.0018 | |
| 2 | StarGraph + TripleRE' | 0.7290 | |
| 3 | TripleRE + StarGraph | 0.7201
±0.0011 | |
| 7 | TripleRE + NodePiece | 0.6582
±0.0020 | This paper |
| 10 | ComplEx-RP | 0.6392
±0.0045 | This paper |
| 15 | TripleREv2 | 0.6045
±0.0017 | This paper |
| 20 | PairRE | 0.5805 best reported | |
| 21 | TripleRE | 0.5794
±0.0020 | This paper |
| 23 | NodePiece + AutoSF | 0.5703
±0.0035 | This paper |
| 25 | AutoSF | 0.5458
±0.0052 | This paper |
| 29 | TransE | 0.4536
±0.0030 best reported | best at pub: PairRE: Knowledge Graph Embeddings via Paired Relation Vectors (2020) |
| 30 | RotatE | 0.4332
±0.0025 | This paper |
| 36 | ComplEx | 0.4028
±0.0030 best reported | best at pub: PairRE: Knowledge Graph Embeddings via Paired Relation Vectors (2020) Difference within reported uncertainty; not counted as underperformance. |
| 39 | DistMult | 0.3729
±0.0045 | This paper |
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | PairRE+LRE | 0.8360 | |
| 2 | NBFnet | 0.8317 | |
| 3 | AutoSF | 0.8309
±0.0008 | This paper |
| 4 | TripleREv2 | 0.8272
±0.0007 | This paper |
| 5 | TripleRE | 0.8191
±0.0014 | This paper |
| 6 | PairRE | 0.8164
±0.0005 | This paper |
| 7 | ComplEx | 0.8095
±0.0007 | This paper |
| 8 | DistMult | 0.8043
±0.0003 | This paper |
| 9 | RotatE | 0.7989
±0.0004 | This paper |
| 11 | TransE | 0.7452
±0.0004 | This paper |
Knowledge Graphs
FB15k-237
Global leaderboard →Default metric is MRR. The paper reports 9 values on MRR , 7 values on MR , 9 values on Hit@10 , 8 values on Hit@3 and 8 values on Hit@1 .
| # | Model | MRR ↑ default | MR ↑ | Hit@10 ↑ | Hit@3 ↑ | Hit@1 ↑ | Paper |
|---|---|---|---|---|---|---|---|
| 1 | sum, Msg_r^3, f(t)=0 | 0.8500 | — | — | — | — | MR
— Hit@10
— Hit@3
— Hit@1
— |
| 2 | sum, Msg_r^3, f(t)=t | 0.8440 | — | — | — | — | MR
— Hit@10
— Hit@3
— Hit@1
— |
| 3 | PNA, Msg_r^1, f(t)=0 | 0.8010 | — | — | — | — | MR
— Hit@10
— Hit@3
— Hit@1
— |
| 27 | OTE | 0.3610 best reported | — | 0.5370 | 0.3880 | 0.2580 | MR
— Hit@10
0.5370 Hit@3
0.3880 Hit@1
0.2580 best at pub: Multi-hop Attention Graph Neural Networks (IJCAI 2020) |
| 29 | GC-OTE | 0.3610 | — | 0.5500 | 0.3960 | 0.2670 | MR
— Hit@10
0.5500 Hit@3
0.3960 Hit@1
0.2670 |
| 33 | DistMult | 0.3580 best reported | 254.0000 | 0.4190 | 0.2630 | 0.1550 | MR
254.0000 Hit@10
0.4190 Hit@3
0.2630 Hit@1
0.1550 best at pub: Knowledge Graphs (AAAI 2017) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 43 | TripleRE | 0.3510 | 142.0000 | 0.5520 | 0.3920 | 0.2510 | MR
142.0000 Hit@10
0.5520 Hit@3
0.3920 Hit@1
0.2510 |
| 42 | PairRE | 0.3510 | 160.0000 | 0.5440 | 0.3870 | 0.2560 | MR
160.0000 Hit@10
0.5440 Hit@3
0.3870 Hit@1
0.2560 |
| 47 | ComplEx | 0.3460 best reported | 339.0000 | 0.4280 | 0.2750 | 0.1580 | MR
339.0000 Hit@10
0.4280 Hit@3
0.2750 Hit@1
0.1580 best at pub: Knowledge Graphs (AAAI 2017) |
| 58 | RotatE | 0.3380 | 177.0000 | 0.5330 | 0.3750 | 0.2410 | MR
177.0000 Hit@10
0.5330 Hit@3
0.3750 Hit@1
0.2410 |
| 67 | TransE | 0.3300 best reported | 357.0000 | 0.4650 | — | — | MR
357.0000 Hit@10
0.4650 Hit@3
— Hit@1
— best at pub: Composition-based Multi-Relational Graph Convolutional Networks (ICLR 2019) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 71 | ConvE | 0.3250 | 244.0000 | 0.5010 | 0.3560 | 0.2370 | MR
244.0000 Hit@10
0.5010 Hit@3
0.3560 Hit@1
0.2370 |
WN18
Global leaderboard →Default metric is MRR. The paper reports 2 values on MRR and 2 values on Hit@10 .
| # | Model | MRR ↑ default | Hit@10 ↑ | Paper |
|---|---|---|---|---|
| 1 | Inverse Model | 0.9630 | — | Hit@10
— |
| 2 | RotatE | 0.9490
±
0.0000 | — | |
| 3 | ConvE | 0.9430 | — | Hit@10
— |
| 10 | TripleRE | 0.7725 | 0.9541 | Hit@10
0.9541 |
| 11 | TransAt | 0.6446 | 0.9510 | Hit@10
0.9510 |
