OGB

ogbn-arxiv

Node Classification PyG dataset page ↗PyG ↗

Structure

1Graphs
169,343Nodes
1,166,243Edges
40Classes
128Node Feature Dim
0.66Homophily

Coverage

147Results
1Variants
27Papers
40-class node classification Predict each paper’s primary arXiv computer-science category from its content representation and citation context. Evaluated by Accuracy.

Dataset details

Task

Predict each paper’s primary arXiv computer-science category from its content representation and citation context. The task is transductive 40-class node classification scored by accuracy.

Data

The directed graph contains 169,343 arXiv CS papers indexed by Microsoft Academic Graph; a directed edge represents a citation. Labels are primary categories assigned through arXiv submission and moderation, and publication years accompany nodes.

Features

Each paper has a 128-dimensional vector formed by averaging skip-gram word embeddings from its title and abstract, trained on the MAG corpus. Raw text is available separately but is not the standard node feature matrix.

Splits and evaluation

Papers published through 2017 are training nodes, 2018 papers are validation, and papers from 2019 onward are test. The full graph is visible, so the protocol is transductive despite its temporal label split.

Quirks and pitfalls

The label is only the primary category even when a paper has cross-lists. Reversing or symmetrizing citation edges changes the input graph and must be disclosed. Random splits remove the intended temporal shift, and newer MAG or arXiv snapshots are not the fixed OGB artifact.

Sources

OGB coverage note: We have not copied the official OGB leaderboard yet. Where possible, we locate the corresponding papers on arXiv and parse their reported results, so some entries may be missing. We plan to integrate the complete leaderboard soon.

SOTA Progression

new SOTA matches SOTA at that time other proposed result other baseline result

Leaderboard

#ModelAccuracy ↑F1InstabilityUnfaithfulnessaccuracy (percent, no explicit header)Paper
1
GIANT-XRT
0.7612 ± 0.0016
————
2
GEGCN
0.7576 ± 0.0064
————
3
AGDN
0.7522 ± 0.0007
————
4
GCN+CNA
0.7464 ± 0.0013
————
5
UniMP
0.7450 ± 0.0005
————
6
BERT+GAE
0.7448 ± 0.0015
————
7
OGB-feat
0.7426 ± 0.0017
————
8
RevGAT
0.7426
————
9
OGB-feat+GAE
0.7406 ± 0.0010
————
10
OGB-feat+VGAE
0.7395 ± 0.0009
————
11
UniMP-v2
0.7392
————
12
OGB-feat+DGI
0.7390 ± 0.0026
————
13
FGSSL
0.7377 ± 0.0030
————
14
LEGNN
0.7371
————
15
GAT
0.7365 ± 0.0011
————
16
BERT+DGI
0.7360 ± 0.0021
————
17
BERT
0.7359 ± 0.0010
————
18
FedTAD
0.7352 ± 0.0039
————
19
FedSage
0.7333 ± 0.0048
————
20
GAT
0.7330 ± 0.0016
————
21
FedGTA
0.7320 ± 0.0022
————
22
FED-PUB
0.7319 ± 0.0022
————
23
WaveGC
0.7301 ± 0.0018
————
24
GCN
0.7300 ± 0.0017
————
25
ANS-GT
0.7284 ± 0.0034
————
26
GraphSAGE
0.7277 ± 0.0016
————
27
SAGE
0.7267 ± 0.0031
————
28
SEA-GWNN
0.7264 ± 0.0021
————
29
SGFormer
0.7263 ± 0.0013
————
30
SIR-GCN
0.7252 ± 0.0016
————
31
OGB-feat+GZ
0.7250 ± 0.0008
————
32
Our Data Partition Soup
0.7235 ± 0.0019
————
33
BERT+GZ
0.7233 ± 0.0006
————
34
DeepGCN
0.7232
————
35
FP
0.7222
————
36
Auto-GNN
0.7213 ± 0.0003
————
37
RL
0.7213 ± 0.0005
————
38
NFGNN
0.7213 ± 0.0033
————
39
MOON
0.7212 ± 0.0033
————
40
Random
0.7204 ± 0.0005
————
41
DEFT
0.7201 ± 0.0020
————
42
GNAS
0.7200 ± 0.0002
————
43
ORC (us)
0.7200 ± 0.0360
————
44
GaAN
0.7197 ± 0.0018
————
45
UFGConv-R
0.7197 ± 0.0012
————
46
UFGConvR
0.7197 ± 0.0012
————
47
SIGN
0.7195 ± 0.0011
————
48
DeeperGCN
0.7192 ± 0.0017
————
49
EA
0.7191 ± 0.0006
————
50
RADE-OF
0.7185 ± 0.0032
————
SOTA performance set a new SOTA at the time matched the SOTA at the time