OGB
ogbl-biokg
Structure
1Graphs
93,773Nodes
5,088,434Edges
Coverage
12Results
1Variants
6Papers
- NeurIPS 2023: A Theory of Link Prediction via Relational Weisfeiler-Leman on Knowledge Graphs A Theory of Link Prediction via Relational Weisfeiler-Leman on Knowledge Graphs NeurIPS 2023
- TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectors TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectors
- PIE: a Parameter and Inference Efficient Solution for Large Scale Knowledge Graph Embedding Reasoning PIE: a Parameter and Inference Efficient Solution for Large Scale Knowledge Graph Embedding Reasoning
- NeurIPS 2021: Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction NeurIPS 2021
- PairRE: Knowledge Graph Embeddings via Paired Relation Vectors PairRE: Knowledge Graph Embeddings via Paired Relation Vectors
- NeurIPS 2020: OGB OGB NeurIPS 2020
Link prediction Predict missing biomedical triples by ranking the true head or tail above sampled replacements of the same entity type. Evaluated by MRR.
Dataset details
Task
Predict missing biomedical triples by ranking the true head or tail above sampled replacements of the same entity type. The official metric is filtered mean reciprocal rank.
Data
The aggregate graph has 93,773 diseases, proteins, drugs, side effects, and protein functions joined by 51 directed relation types. These include 38 drug-drug and eight protein-protein relations plus drug-protein, drug-side-effect, and function relations.
Features
The standard task provides entity types, relation types, and graph structure but no unified molecular, sequence, or textual node feature matrix. Same-type relations are represented symmetrically with both directions.
Splits and evaluation
Triples are randomly split because reliable timestamps for the underlying experiments and observations could not be recovered. Negative heads and tails are sampled only from the correct entity type and filtered against known triples.
Quirks and pitfalls
The source repositories mix experimental measurements, curated annotations, and automatically extracted metadata with different confidence and possible contradictions. Random splitting can place closely related evidence across splits, and missing facts are not reliable negatives. External biomedical features must be disclosed.
Sources
SOTA Progression
new SOTA
matches SOTA at that time
other proposed result
other baseline result
Leaderboard
| # | Model | MRR ↑ | Paper |
|---|---|---|---|
| 1 | PairRE+LRE | 0.8360 | |
| 2 | NBFnet | 0.8317 | |
| 3 | AutoSF | 0.8309 | |
| 4 | TripleREv2 | 0.8272
±
0.0007 | |
| 5 | TripleRE | 0.8191
±
0.0014 | |
| 6 | PairRE | 0.8164
±
0.0005 | |
| 7 | ComplEx | 0.8095
±
0.0007 | |
| 8 | DistMult | 0.8043
±
0.0003 | |
| 9 | RotatE | 0.7989
±
0.0004 | |
| 10 | C-MPNN | 0.7900 | |
| 11 | TransE | 0.7452
±
0.0004 | |
| 12 | RGCN | 0.6360 |
SOTA performance
set a new SOTA at the time
matched the SOTA at the time