Modeling Relational Data with Graph Convolutional Networks
Abstract
Knowledge graphs enable a wide variety of applications, including question answering and information retrieval. Despite the great effort invested in their creation and maintenance, even the largest (e.g., Yago, DBPedia or Wikidata) remain incomplete. We introduce Relational Graph Convolutional Networks (R-GCNs) and apply them to two standard knowledge base completion tasks: Link prediction (recovery of missing facts, i.e. subject-predicate-object triples) and entity classification (recovery of missing entity attributes). R-GCNs are related to a recent class of neural networks operating on graphs, and are developed specifically to deal with the highly multi-relational data characteristic of realistic knowledge bases. We demonstrate the effectiveness of R-GCNs as a stand-alone model for entity classification. We further show that factorization models for link prediction such as DistMult can be significantly improved by enriching them with an encoder model to accumulate evidence over multiple inference steps in the relational graph, demonstrating a large improvement of 29.8\
Benchmark Results
Tested on 2 datasets 3 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
TU Dortmund
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | MSH-GNN | 0.9910
±0.0030 | |
| 2 | ID-GNN+BEC | 0.9830
±0.0360 | |
| 3 | SupCosine | 0.9830
±0.0250 | |
| 39 | GIN | 0.9330
±0.0290 | |
| 159 | WL | 0.9040
±0.0570 best reported | best at pub: On Valid Optimal Assignment Kernels and Applications to Graph Classification (NeurIPS 2016) best today: How Powerful are $K$-hop Message Passing Graph Neural Networks (NeurIPS 2022) |
| 403 | MLP | 0.8660
±0.0495 | |
| 665 | Feat | 0.7794 | This paper |
| 740 | R-GCN | 0.7323
±0.0048 | This paper |
| 768 | RDF2Vec | 0.6720
±0.0124 | This paper |
Knowledge Graphs
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | Inverse Model | 0.9630 | |
| 2 | RotatE | 0.9490 | |
| 3 | ConvE | 0.9430 | |
| 5 | ComplEx | 0.9410 | This paper |
| 7 | LinkFeat | 0.9380 | This paper |
| 6 | HolE | 0.9380 | This paper |
| 8 | DistMult | 0.8220 best reported | best at pub: Complex Embeddings for Simple Link Prediction (ICML 2016) best today: Knowledge Graphs (AAAI 2017) |
| 9 | R-GCN | 0.8190 | This paper |
| 12 | TransE | 0.4540 | This paper |
| 13 | CP | 0.0750 best reported | best at pub: Complex Embeddings for Simple Link Prediction (ICML 2016) |
