A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal
Abstract
Knowledge graph reasoning (KGR), aiming to deduce new facts from existing facts based on mined logic rules underlying knowledge graphs (KGs), has become a fast-growing research direction. It has been proven to significantly benefit the usage of KGs in many AI applications, such as question answering, recommendation systems, and etc. According to the graph types, existing KGR models can be roughly divided into three categories, i.e., static models, temporal models, and multi-modal models. Early works in this domain mainly focus on static KGR, and recent works try to leverage the temporal and multi-modal information, which are more practical and closer to real-world. However, no survey papers and open-source repositories comprehensively summarize and discuss models in this important direction. To fill the gap, we conduct a first survey for knowledge graph reasoning tracing from static to temporal and then to multi-modal KGs. Concretely, the models are reviewed based on bi-level taxonomy, i.e., top-level (graph types) and base-level (techniques and scenarios). Besides, the performances, as well as datasets, are summarized and presented. Moreover, we point out the challenges and potential opportunities to enlighten the readers. The corresponding open-source repository is shared on GitHub https://github.com/LIANGKE23/Awesome-Knowledge-Graph-Reasoning.
Benchmark Results
Tested on 2 datasets 10 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Knowledge Graphs
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | FedSage | 0.8426
±0.0026 | |
| 2 | FED-PUB | 0.8348
±0.0025 | |
| 3 | FedAvg | 0.8252
±0.0023 | |
| 7 | GCN | 0.8171
±0.0030 | |
| 11 | NeuralLP | 0.7440 best reported | best today: A Theory of Link Prediction via Relational Weisfeiler-Leman on Knowledge Graphs (NeurIPS 2023) |
| 13 | RED-GNN | 0.7010 best reported | best at pub: Knowledge Graph Reasoning with Relational Digraph (WWW 2021) |
| 36 | HousE | 0.5110 | This paper |
| 40 | HAKE | 0.4970 | This paper |
| 47 | ComplEX-DURA | 0.4890 | This paper |
| 48 | QuatE | 0.4880 best reported | best at pub: Multi-hop Attention Graph Neural Networks (IJCAI 2020) |
| 50 | RGHAT | 0.4830 | This paper |
| 52 | DualE | 0.4820 | This paper |
| 53 | DPMPN | 0.4820 | This paper |
| 54 | MuRP | 0.4810 | This paper |
| 55 | ConEx | 0.4810 | This paper |
| 60 | CompGCN | 0.4790 best reported | best at pub: Composition-based Multi-Relational Graph Convolutional Networks (ICLR 2019) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 62 | RotatE | 0.4770 best reported | best at pub: RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (ICLR 2018) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 63 | ConvR | 0.4750 | This paper |
| 68 | TuckER | 0.4700 | This paper |
| 69 | SACN | 0.4700 | This paper |
| 71 | HypER | 0.4650 | This paper |
| 72 | LowFER | 0.4650 | This paper |
| 74 | KBGAT | 0.4640 | This paper |
| 75 | InteractE | 0.4630 | This paper |
| 77 | CURL | 0.4600 | This paper |
| 78 | RESCAL | 0.4550 | This paper |
| 82 | MINERVA | 0.4480 | This paper |
| 83 | pLogicNet | 0.4410 | This paper |
| 84 | ComplEx | 0.4400 | This paper |
| 85 | M-walk | 0.4370 | This paper |
| 88 | DisMult | 0.4300 best reported | best at pub: AutoGEL: An Automated Graph Neural Network with Explicit Link Information (NeurIPS 2021) |
| 89 | ConvE | 0.4300 | This paper |
| 92 | RGCN | 0.4270 | This paper |
| 98 | ConvKB | 0.2650 | prev best: Composition-based Multi-Relational Graph Convolutional Networks (ICLR 2019) |
| 100 | TransE | 0.2310 | This paper |
FB15k-237
Global leaderboard →Default metric is MRR. The paper reports 31 values on MRR and 13 values on Hits@10 .
| # | Model | MRR ↑ default | Hits@10 ↑ | Paper |
|---|---|---|---|---|
| 1 | sum, Msg_r^3, f(t)=0 | 0.8500 | — | |
| 2 | sum, Msg_r^3, f(t)=t | 0.8440 | — | |
| 3 | PNA, Msg_r^1, f(t)=0 | 0.8010 | — | |
| 8 | IMF | —
| 0.5930 | Hits@10
0.5930 |
| 8 | MOSE | —
| 0.5650 | Hits@10
0.5650 |
| 8 | HRGAT | —
| 0.5420 | Hits@10
0.5420 |
| 8 | MKBE | —
| 0.5320 | Hits@10
0.5320 |
| 8 | RGHAT | 0.5220 | — | Hits@10
— |
| 9 | MKGformer | —
| 0.4990 | Hits@10
0.4990 |
| 9 | MTRL | —
| 0.4940 | Hits@10
0.4940 |
| 9 | KBLRN | —
| 0.4930 | Hits@10
0.4930 |
| 9 | VBKGC | —
| 0.4780 | Hits@10
0.4780 |
| 9 | RSME | —
| 0.4670 | Hits@10
0.4670 |
| 9 | TransAE | —
| 0.4630 | Hits@10
0.4630 |
| 9 | IKRL | —
| 0.4580 | Hits@10
0.4580 |
| 9 | ViLBERT | —
| 0.4570 | Hits@10
0.4570 |
| 9 | VisualBERT | —
| 0.4390 | Hits@10
0.4390 |
| 16 | RED-GNN | 0.3740 | — | Hits@10
— |
| 19 | ComplEX-DURA | 0.3700 | — | Hits@10
— |
| 20 | DPMPN | 0.3690 | — | Hits@10
— |
| 23 | QuatE | 0.3660 best reported | — | Hits@10
— best at pub: Multi-hop Attention Graph Neural Networks (IJCAI 2020) |
| 24 | ConEx | 0.3660 | — | Hits@10
— |
| 26 | HousE | 0.3610 | — | Hits@10
— |
| 31 | LowFER | 0.3590 | — | Hits@10
— |
| 32 | TuckER | 0.3580 | — | Hits@10
— |
| 35 | CompGCN | 0.3550 best reported | — | Hits@10
— best at pub: Composition-based Multi-Relational Graph Convolutional Networks (ICLR 2019) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 36 | InteractE | 0.3540 | — | Hits@10
— |
| 38 | RESCAL | 0.3530 | — | Hits@10
— |
| 44 | ConvR | 0.3500 | — | Hits@10
— |
| 45 | SACN | 0.3500 | — | Hits@10
— |
| 46 | KBGAT | 0.3500 | — | Hits@10
— |
| 47 | ComplEx | 0.3460 | — | Hits@10
— prev best: Knowledge Graphs (AAAI 2017) |
| 55 | HAKE | 0.3410 best reported | — | Hits@10
— best at pub: A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphs (NeurIPS 2022) |
| 56 | HypER | 0.3410 | — | Hits@10
— |
| 58 | RotatE | 0.3380 | — | Hits@10
— |
| 61 | MuRP | 0.3350 | — | Hits@10
— |
| 65 | pLogicNet | 0.3320 | — | Hits@10
— |
| 67 | TransE | 0.3300 best reported | — | Hits@10
— best at pub: Composition-based Multi-Relational Graph Convolutional Networks (ICLR 2019) best today: KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning (ICML 2024) |
| 68 | DualE | 0.3300 | — | Hits@10
— |
| 71 | ConvE | 0.3250 | — | Hits@10
— |
| 79 | CURL | 0.3060 | — | Hits@10
— |
| 80 | MINERVA | 0.2930 best reported | — | Hits@10
— best at pub: Knowledge Graph Reasoning with Relational Digraph (WWW 2021) |
| 83 | ConvKB | 0.2890 | — | Hits@10
— prev best: Composition-based Multi-Relational Graph Convolutional Networks (ICLR 2019) |
| 87 | RGCN | 0.2730 best reported | — | Hits@10
— best at pub: Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction (NeurIPS 2021) |
| 92 | DisMult | 0.2430 | — | Hits@10
— |
| 93 | M-walk | 0.2340 | — | Hits@10
— |
| 94 | NeuralLP | 0.2270 | — | Hits@10
— |
