ICLR 2019

Composition-based Multi-Relational Graph Convolutional Networks

Shikhar Vashishth, Soumya Sanyal, V. Nitin, P. Talukdar

Main figure for Composition-based Multi-Relational Graph Convolutional Networks

Abstract

Graph Convolutional Networks (GCNs) have recently been shown to be quite successful in modeling graph-structured data. However, the primary focus has been on handling simple undirected graphs. Multi-relational graphs are a more general and prevalent form of graphs where each edge has a label and direction associated with it. Most of the existing approaches to handle such graphs suffer from over-parameterization and are restricted to learning representations of nodes only. In this paper, we propose CompGCN, a novel Graph Convolutional framework which jointly embeds both nodes and relations in a relational graph. CompGCN leverages a variety of entity-relation composition operations from Knowledge Graph Embedding techniques and scales with the number of relations. It also generalizes several of the existing multi-relational GCN methods. We evaluate our proposed method on multiple tasks such as node classification, link prediction, and graph classification, and achieve demonstrably superior results. We make the source code of CompGCN available to foster reproducible research.

Proposed method: CompGCN

Benchmark Results

Tested on 2 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Knowledge Graphs

#ModelMRR ↑Paper
1
FedSage
0.8426 ±0.0026
2
FED-PUB
0.8348 ±0.0025
3
FedAvg
0.8252 ±0.0023
7
GCN
0.8171 ±0.0030
60
CompGCN
0.4790
This paper
62
RotatE
actual #62 vs paper #62
0.4770
best reported
actual #62 vs paper #62
paper 0.4760
paper 0.4760 Δ at pub 0.0010 Δ today 0.0010
63
ConvR
0.4750
This paper
69
SACN
0.4700
This paper
71
HypER
0.4650
This paper
79
DistMult
actual #79 vs paper #87 8 places worse
0.4550
best reported
actual #79 vs paper #87 8 places worse
paper 0.4300
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.4300 Δ today 0.0250
84
ComplEx
0.4400
This paper
89
ConvE
0.4300
This paper
98
ConvKB
actual #98 vs paper #98
0.2650
best reported
actual #98 vs paper #98
paper 0.2490
100
TransE
actual #100 vs paper #101 1 place worse
0.2310
best reported
actual #100 vs paper #101 1 place worse
paper 0.2260
103
KBGAN
0.2140
This paper
#ModelMRR ↑Paper
1
sum, Msg_r^3, f(t)=0
0.8500
2
sum, Msg_r^3, f(t)=t
0.8440
3
PNA, Msg_r^1, f(t)=0
0.8010
33
DistMult
actual #33 vs paper #92 59 places worse
0.3580
best reported
actual #33 vs paper #92 59 places worse
paper 0.2410
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.2410 Δ today 0.1170
35
CompGCN
0.3550
This paper
45
SACN
0.3500
This paper
44
ConvR
0.3500
This paper
47
ComplEx
actual #47 vs paper #91 44 places worse
0.3460
best reported
actual #47 vs paper #91 44 places worse
paper 0.2470
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.2470 Δ today 0.0990
56
HypER
0.3410
This paper
58
RotatE
0.3380
This paper
67
TransE
actual #67 vs paper #79 12 places worse
0.3300
best reported
actual #67 vs paper #79 12 places worse
paper 0.2940
paper 0.2940 Δ today 0.0360
71
ConvE
0.3250
This paper
83
ConvKB
actual #83 vs paper #91 8 places worse
0.2890
best reported
actual #83 vs paper #91 8 places worse
paper 0.2430
85
KBGAN
0.2780
This paper
89
R-GCN
actual #89 vs paper #90 1 place worse
0.2490
best reported
actual #89 vs paper #90 1 place worse
paper 0.2480
best at pub: Knowledge Graphs (AAAI 2017)
paper 0.2480 Δ today 0.0010
91
VR-GCN
0.2480
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere