Heterogeneous Graph Benchmarks

DBLP

Node Classification PyG dataset page ↗PyG ↗

Structure

1Graphs
26,128Nodes
239,566Edges
4Classes
334Node Feature Dim

Coverage

534Results
1Variants
62Papers
4-class node classification Heterogeneous academic graph — classify author nodes (4 research areas). Uses typed nodes, typed relations, and available type-specific features. Evaluated by Micro-F1.

Dataset details

Task

Heterogeneous academic graph — classify author nodes (4 research areas). The primary catalog metric is Micro-F1.

Data

Heterogeneous academic graph — classify author nodes (4 research areas). The cataloged artifact reports 1 graphs, 4 target classes or tasks.

Features

Inputs are typed graphs with relation-specific edges and type-specific feature matrices where available. Some node types lack native features, so learned embeddings or propagated features are modeling choices rather than measured attributes.

Splits and evaluation

The catalog records these protocols or variants: Standard split. Evaluation uses Micro-F1 (higher is better). Exact masks or folds must come from the cited release.

Quirks and pitfalls

Schema, reverse-edge creation, feature propagation, and negative sampling materially affect results. Report the exact release and target type; random edge splits may leak future or reciprocal information.

Sources

SOTA Progression

new SOTA matches SOTA at that time other proposed result other baseline result

Leaderboard

#ModelMicro-F1 ↑ACCARIAccuracyCOSConductanceF1F1-microMacro F1Macro-F1NMIROC-AUCUnweighted F1 MeasurePaper
1
LMSPS
0.9566 ± 0.0020
————————————
2
PSHGCN
0.9561 ± 0.0012
————————————
3
RpHGNN
0.9555 ± 0.0029
————————————
4
FusedGAT+GPL
0.9544 ± 0.0023
————————————
5
SeHGNN
0.9542 ± 0.0017
————————————
6
SlotGAT
0.9531 ± 0.0019
————————————
7
MHGCN
0.9520 ± 0.0203
————————————
8
PMMM
0.9514 ± 0.0022
————————————
9
EM-GCN[PT]
0.9506 ± 0.0039
————————————
10
GraMI
0.9503
————————————
11
EM-GCN[PH]
0.9502 ± 0.0019
————————————
12
EM-GCN[PO]
0.9495 ± 0.0024
————————————
13
HINormer
0.9494 ± 0.0021
————————————
14
EM-GCN[PD]
0.9489 ± 0.0017
————————————
15
SeHGNN
0.9486 ± 0.0014
————————————
16
SHGN (HDHGR)
0.9473 ± 0.0016
————————————
17
SCHOOL
0.9470 ± 0.0040
————————————
18
ConCH
0.9470
————————————
19
GAT (HDHGR)
0.9470 ± 0.0011
————————————
20
space4HGNN
0.9463 ± 0.0040
————————————
21
NARS
0.9461 ± 0.0042
————————————
22
GCN
0.9460 ± 0.0031
————————————
23
MAGNN
0.9456
————————————
24
GAT
0.9448 ± 0.0022
————————————
25
simpleHGN
0.9446 ± 0.0020
————————
0.9401 ± 0.0027
———
26
HGB
0.9446 ± 0.0022
————————————
27
Simple-HGN
0.9446 ± 0.0022
————————————
28
GraphMSE
0.9444 ± 0.0013
————————————
29
HERO
0.9440 ± 0.0040
————————————
30
HGCA
0.9434
————————————
31
DiffMG
0.9420 ± 0.0036
————————————
32
DisenHAN
0.9418 ± 0.0036
————————
0.9366 ± 0.0039
———
33
Transformer
0.9399 ± 0.0011
————————————
34
GTN
0.9397 ± 0.0054
————————————
35
Random
0.9384 ± 0.0053
————————————
36
RSHN
0.9381 ± 0.0055
————————————
37
CPIM
0.9380 ± 0.0080
————————————
38
MAGNN
0.9376 ± 0.0045
————————————
39
LINKX (HDHGR)
0.9369 ± 0.0026
————————————
40
HAN
0.9369
————————————
41
HGT
0.9365
————————————
42
HGCML-P
0.9344 ± 0.0008
————————————
43
HGMAE
0.9340 ± 0.0060
————————————
44
FusedGAT
0.9340 ± 0.0020
————————————
45
GAT
0.9339 ± 0.0030
————————————
46
HetGNN
0.9336
————————————
47
DMGI
0.9331
————————————
48
HGCML
0.9329 ± 0.0012
————————————
49
GCN
0.9310
————————————
50
GraphSAGE
0.9306 ± 0.0047
————————————
SOTA performance set a new SOTA at the time matched the SOTA at the time