Link prediction Predict missing biomedical triples by ranking the true head or tail above sampled replacements of the same entity type. Evaluated by MRR.

Dataset details

Task

Predict missing biomedical triples by ranking the true head or tail above sampled replacements of the same entity type. The official metric is filtered mean reciprocal rank.

Data

The aggregate graph has 93,773 diseases, proteins, drugs, side effects, and protein functions joined by 51 directed relation types. These include 38 drug-drug and eight protein-protein relations plus drug-protein, drug-side-effect, and function relations.

Features

The standard task provides entity types, relation types, and graph structure but no unified molecular, sequence, or textual node feature matrix. Same-type relations are represented symmetrically with both directions.

Splits and evaluation

Triples are randomly split because reliable timestamps for the underlying experiments and observations could not be recovered. Negative heads and tails are sampled only from the correct entity type and filtered against known triples.

Quirks and pitfalls

The source repositories mix experimental measurements, curated annotations, and automatically extracted metadata with different confidence and possible contradictions. Random splitting can place closely related evidence across splits, and missing facts are not reliable negatives. External biomedical features must be disclosed.

Sources

OGB coverage note: We have not copied the official OGB leaderboard yet. Where possible, we locate the corresponding papers on arXiv and parse their reported results, so some entries may be missing. We plan to integrate the complete leaderboard soon.

SOTA Progression

new SOTA matches SOTA at that time other proposed result other baseline result

Leaderboard

#ModelMRR ↑Paper
1
PairRE+LRE
0.8360
2
NBFnet
0.8317
3
AutoSF
0.8309
4
TripleREv2
0.8272 ± 0.0007
5
TripleRE
0.8191 ± 0.0014
6
PairRE
0.8164 ± 0.0005
7
ComplEx
0.8095 ± 0.0007
8
DistMult
0.8043 ± 0.0003
9
RotatE
0.7989 ± 0.0004
10
C-MPNN
0.7900
11
TransE
0.7452 ± 0.0004
12
RGCN
0.6360
SOTA performance set a new SOTA at the time matched the SOTA at the time