Modeling Relational Data with Graph Convolutional Networks

M. Schlichtkrull, Thomas Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, M. Welling

Main figure for Modeling Relational Data with Graph Convolutional Networks

Abstract

Knowledge graphs enable a wide variety of applications, including question answering and information retrieval. Despite the great effort invested in their creation and maintenance, even the largest (e.g., Yago, DBPedia or Wikidata) remain incomplete. We introduce Relational Graph Convolutional Networks (R-GCNs) and apply them to two standard knowledge base completion tasks: Link prediction (recovery of missing facts, i.e. subject-predicate-object triples) and entity classification (recovery of missing entity attributes). R-GCNs are related to a recent class of neural networks operating on graphs, and are developed specifically to deal with the highly multi-relational data characteristic of realistic knowledge bases. We demonstrate the effectiveness of R-GCNs as a stand-alone model for entity classification. We further show that factorization models for link prediction such as DistMult can be significantly improved by enriching them with an encoder model to accumulate evidence over multiple inference steps in the relational graph, demonstrating a large improvement of 29.8\

Proposed method: R-GCN

Benchmark Results

Tested on 2 datasets 3 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
159
WL
actual #159 vs paper #592 433 places worse
0.9040 ±0.0570
best reported
actual #159 vs paper #592 433 places worse
paper 0.8088
paper 0.8088 Δ at pub 0.0512 Δ today 0.0952
403
MLP
0.8660 ±0.0495
665
Feat
0.7794
This paper
740
R-GCN
0.7323 ±0.0048
This paper
768
RDF2Vec
0.6720 ±0.0124
This paper

Knowledge Graphs

#ModelMRR ↑Paper
1
Inverse Model
0.9630
2
RotatE
0.9490
3
ConvE
0.9430
5
ComplEx
0.9410
This paper
7
LinkFeat
0.9380
This paper
6
HolE
0.9380
This paper
8
DistMult
actual #8 vs paper #9 1 place worse
0.8220
best reported
actual #8 vs paper #9 1 place worse
paper 0.8130
best today: Knowledge Graphs (AAAI 2017)
paper 0.8130 Δ at pub 0.0090 Δ today 0.0090
9
R-GCN
0.8190
This paper
12
TransE
0.4540
This paper
13
CP
actual #13 vs paper #13
0.0750
best reported
actual #13 vs paper #13
paper 0.0580
paper 0.0580 Δ at pub 0.0170
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green)