Composition-based Multi-Relational Graph Convolutional Networks
Abstract
Graph Convolutional Networks (GCNs) have recently been shown to be quite successful in modeling graph-structured data. However, the primary focus has been on handling simple undirected graphs. Multi-relational graphs are a more general and prevalent form of graphs where each edge has a label and direction associated with it. Most of the existing approaches to handle such graphs suffer from over-parameterization and are restricted to learning representations of nodes only. In this paper, we propose CompGCN, a novel Graph Convolutional framework which jointly embeds both nodes and relations in a relational graph. CompGCN leverages a variety of entity-relation composition operations from Knowledge Graph Embedding techniques and scales with the number of relations. It also generalizes several of the existing multi-relational GCN methods. We evaluate our proposed method on multiple tasks such as node classification, link prediction, and graph classification, and achieve demonstrably superior results. We make the source code of CompGCN available to foster reproducible research.
Benchmark Results
Tested on 2 datasets
Tables show presented results in global context (best 3 papers + GCN + MLP).
Knowledge Graphs
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | FedSage | 0.8426
±0.0026 | |
| 2 | FED-PUB | 0.8348
±0.0025 | |
| 3 | FedAvg | 0.8252
±0.0023 | |
| 7 | GCN | 0.8171
±0.0030 | |
| 60 | CompGCN | 0.4790 | This paper |
| 62 | RotatE | 0.4770 best reported | best at pub: RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (ICLR 2018) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 63 | ConvR | 0.4750 | This paper |
| 69 | SACN | 0.4700 | This paper |
| 71 | HypER | 0.4650 | This paper |
| 79 | DistMult | 0.4550 best reported | best at pub: Knowledge Graphs (AAAI 2017) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 84 | ComplEx | 0.4400 | This paper |
| 89 | ConvE | 0.4300 | This paper |
| 98 | ConvKB | 0.2650 best reported | |
| 100 | TransE | 0.2310 best reported | best at pub: RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (ICLR 2018) |
| 103 | KBGAN | 0.2140 | This paper |
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | sum, Msg_r^3, f(t)=0 | 0.8500 | |
| 2 | sum, Msg_r^3, f(t)=t | 0.8440 | |
| 3 | PNA, Msg_r^1, f(t)=0 | 0.8010 | |
| 33 | DistMult | 0.3580 best reported | best at pub: Knowledge Graphs (AAAI 2017) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 35 | CompGCN | 0.3550 | This paper |
| 45 | SACN | 0.3500 | This paper |
| 44 | ConvR | 0.3500 | This paper |
| 47 | ComplEx | 0.3460 best reported | best at pub: Knowledge Graphs (AAAI 2017) |
| 56 | HypER | 0.3410 | This paper |
| 58 | RotatE | 0.3380 | This paper |
| 67 | TransE | 0.3300 best reported | best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 71 | ConvE | 0.3250 | This paper |
| 83 | ConvKB | 0.2890 best reported | |
| 85 | KBGAN | 0.2780 | This paper |
| 89 | R-GCN | 0.2490 best reported | best at pub: Knowledge Graphs (AAAI 2017) best today: Multi-hop Attention Graph Neural Networks (IJCAI 2020) |
| 91 | VR-GCN | 0.2480 | This paper |
