GNNBenchmark

MNIST

Graph Classification PyG dataset page ↗PyG ↗

Structure

70,000Graphs
71Nodes
565Edges
10Classes
3Node Feature Dim
1Edge Feature Dim

Coverage

173Results
1Variants
34Papers
10-class graph classification Graph classification on MNIST superpixel graphs (10 digit classes, 70k graphs). Uses the benchmark-provided synthetic or superpixel node/edge features. Evaluated by Accuracy.

Dataset details

Task

Graph classification on MNIST superpixel graphs (10 digit classes, 70k graphs). The primary catalog metric is Accuracy.

Data

Graph classification on MNIST superpixel graphs (10 digit classes, 70k graphs).

Features

The benchmark release supplies fixed graph tensors and task-specific node or edge inputs. Image graphs use superpixel appearance and position, synthetic node tasks use generated signals, TSP uses coordinates, and CSL is intentionally featureless.

Splits and evaluation

The catalog records these protocols or variants: Standard split. Evaluation uses Accuracy (higher is better). Exact masks or folds must come from the cited release.

Quirks and pitfalls

Use the released train/validation/test files rather than resplitting. These tasks were designed to expose specific architectural limitations, and preprocessing such as changing superpixels, adding positional encodings, or balancing edge labels changes the benchmark.

Sources

SOTA Progression

new SOTA matches SOTA at that time other proposed result other baseline result

Leaderboard

#ModelAccuracy ↑Paper
1
Schrödinger
0.9913 ± 0.0004
2
CNN
0.9907 ± 0.0007
3
MPNN
0.9895 ± 0.0006
4
GraphCON-GAT
0.9891
5
GIG-GatedGCN
0.9880 ± 0.0003
6
PNCNN
0.9876
7
Ours(100K)
0.9874 ± 0.0006
8
GraphCON-GCN
0.9868
9
PPGT
0.9861 ± 0.0010
10
differential encoding
0.9856 ± 0.0006
11
GatedGCN
0.9855 ± 0.0002
12
GatedGCN + RandAlign
0.9855 ± 0.0002
13
Exphormer
0.9855 ± 0.0004
14
GraphCON-GIN
0.9853
15
RandAlign
0.9851 ± 0.0005
16
LRGA + GatedGCN
0.9847 ± 0.0016
17
GatedGCN-ViT
0.9846 ± 0.0009
18
EdgeGCN
0.9843 ± 0.0006
19
CKGCN
0.9842 ± 0.0015
20
Exphormer + RRWP
0.9842 ± 0.0018
21
Exphormer + RWDIFF
0.9842 ± 0.0006
22
Exphormer + noPE
0.9841 ± 0.0005
23
LRGA + GAT
0.9841 ± 0.0008
24
Exphormer + GCKN
0.9840 ± 0.0007
25
Exphormer + WLPE
0.9840 ± 0.0016
26
GMN
0.9839 ± 0.0018
27
GRED
0.9838 ± 0.0001
28
EGTAS
0.9837 ± 0.0026
29
Exphormer + ESLapPE
0.9835 ± 0.0011
30
LRGA+GCN
0.9834 ± 0.0006
31
GIN
0.9833 ± 0.0011
32
Graph MLP-Mixer
0.9832 ± 0.0004
33
GatedGCN-MLP-Mixer
0.9832 ± 0.0004
34
GraphCON-GatedGCN
0.9827
35
Exphormer + LapPE
0.9827 ± 0.0007
36
Exphormer + RWSE
0.9825 ± 0.0008
37
GatedGCN
0.9824 ± 0.0004
38
GCCM
0.9824 ± 0.0006
39
DeGTA
0.9823 ± 0.0011
40
TIGT
0.9823 ± 0.0013
Feb 2024 Feb '24
41
TAU-GRIT
0.9821 ± 0.0010
42
GPS + Mamba
0.9821 ± 0.0004
43
GRIT 2-QiQRW
0.9820 ± 0.0005
44
GINE-ViT
0.9820 ± 0.0005
45
TANGO-GPS
0.9820 ± 0.0011
46
GraphGPS + ESLapPE
0.9818 ± 0.0012
47
GraphGPS + GCKN
0.9818 ± 0.0012
48
EGT
0.9817 ± 0.0009
49
GRIT (our run)
0.9816 ± 0.0005
50
GPS + HOPE-WavePE
0.9815 ± 0.0011
SOTA performance set a new SOTA at the time matched the SOTA at the time