OGB

ogbn-mag

Node Classification PyG dataset page ↗PyG ↗

Structure

1Graphs
1,939,743Nodes
21,111,007Edges
349Classes
128Node Feature Dim
0.9205Heterophily

Coverage

106Results
1Variants
17Papers
349-class node classification Predict the conference or journal of each paper using paper content, citations, authors, affiliations, and fields of study. Evaluated by Accuracy.

Dataset details

Task

Predict the conference or journal of each paper using paper content, citations, authors, affiliations, and fields of study. It is a 349-class paper-node classification task scored by accuracy.

Data

The heterogeneous graph has paper, author, institution, and field-of-study nodes, connected by writes, affiliation, citation, and topic relations. It contains 736,389 papers within 1,939,743 total entities.

Features

Only paper nodes receive standard input features, each a 128-dimensional average word2vec representation of title and abstract. Other entity types must obtain representations from identifiers or graph structure rather than supplied content features.

Splits and evaluation

Papers published before 2018 train the model, 2018 papers validate it, and papers from 2019 onward form test. The complete heterogeneous topology is present in the transductive graph.

Quirks and pitfalls

Venue labels in MAG can be noisy or missing, and the graph snapshot is no longer a live reflection of the scholarly record. Collapsing relation or node types changes the benchmark. Methods using additional author, venue, or text metadata must distinguish it from the standard inputs.

Sources

OGB coverage note: We have not copied the official OGB leaderboard yet. Where possible, we locate the corresponding papers on arXiv and parse their reported results, so some entries may be missing. We plan to integrate the complete leaderboard soon.

SOTA Progression

new SOTA matches SOTA at that time other proposed result other baseline result

Leaderboard

#ModelAccuracy ↑InstabilityUnfaithfulnessPaper
1
LMSPS+LP+MS
0.5784 ± 0.0022
——
2
SeHGNN+emb+ms
0.5719 ± 0.0012
——
3
SeHGNN+ms
0.5671 ± 0.0014
——
4
SeHGNN+LP+MS
0.5671 ± 0.0014
——
5
RLU+SCR
0.5631 ± 0.0021
——
6
RLU
0.5590 ± 0.0027
——
7
GAMLP+emb+ms
0.5590 ± 0.0027
——
8
NARS-GAMLP+RLU
0.5590 ± 0.0027
——
9
LMSPS+LP
0.5510 ± 0.0011
——
10
LMSPS
0.5483 ± 0.0020
——
11
SeHGNN+emb
0.5478 ± 0.0017
——
12
SCR-m
0.5451 ± 0.0019
——
13
SLE
0.5440 ± 0.0015
——
14
SAGN+emb+ms
0.5440 ± 0.0015
——
15
NARS-SAGN+2-SLE
0.5440 ± 0.0015
——
16
SCR
0.5432 ± 0.0018
——
17
HGUL
0.5421 ± 0.0027
——
18
SeHGNN
0.5399 ± 0.0018
——
19
SeHGNN+LP
0.5399 ± 0.0018
——
20
NARS_GAMLP
0.5396 ± 0.0018
——
21
GAMLP+emb
0.5396 ± 0.0018
——
22
NARS-GAMLP
0.5396 ± 0.0018
——
23
LEGNN + AS-Train
0.5378 ± 0.0016
——
24
LEGNN
0.5378
——
25
LEGNN with SuperNorm
0.5324 ± 0.0013
——
26
H2G-former
0.5312 ± 0.0032
——
27
SIGN
0.5289 ± 0.0011
——
28
LEGNN
0.5276 ± 0.0014
——
29
NARS+emb
0.5240 ± 0.0016
——
30
NARS
0.5240 ± 0.0016
——
31
NARS_SAGN
0.5232 ± 0.0025
——
32
NARS-SAGN+0-SLE
0.5232 ± 0.0025
——
33
RpHGNN
0.5207 ± 0.0017
——
34
R-HGNN
0.5204
——
35
GAMLP
0.5163 ± 0.0022
——
36
GAMLP+LP
0.5163 ± 0.0022
——
37
Hetero2Net
0.5160 ± 0.0033
——
38
SeHGNN
0.5145 ± 0.0029
——
39
SAGN
0.5117 ± 0.0032
——
40
SAGN+LP
0.5117 ± 0.0032
——
41
R-GraphSAGE
0.5094 ± 0.0044
——
42
NARS
0.5088 ± 0.0012
——
43
NARS
0.5066 ± 0.0022
——
44
HGConv
0.5045 ± 0.0017
——
45
R-GSN
0.5032 ± 0.0037
——
46
HGT
0.5023 ± 0.0048
——
47
SCNode
0.5003
——
48
HGT+emb
0.4982 ± 0.0013
——
49
GraphSAINT + metapath2vec
0.4969 ± 0.0022
——
50
HGT
0.4921
——
SOTA performance set a new SOTA at the time matched the SOTA at the time