GraphBench

Algorithmic Reasoning

Graph Classification Dataset page ↗

Mixed node/edge/graph prediction suite covering topological sorting, maximum flow, MST, bridges, Steiner tree, maximum clique, and matching with task-specific node, edge, or graph targets. Evaluated by Accuracy.

Dataset details

Task

Simulate seven graph algorithms through node regression, node classification, or edge classification: topological sorting, maximum flow, minimum spanning tree, bridge finding, Steiner tree, maximum clique, and maximum matching.

Data

Each algorithm has easy, medium, and hard synthetic datasets whose train and test graphs differ in generator distribution. Training graphs have 16 nodes while held-out graphs include 128 nodes, with additional size-generalization tests up to 512 nodes in the published experiments.

Features

Inputs encode the graph, algorithm-specific weights or designated vertices, and task-relevant node or edge attributes. Unlike CLRS-style processor supervision, these datasets focus on final outputs rather than providing a full sequence of algorithmic hints.

Splits and evaluation

Fixed 98%/1%/1% splits contain about one million graphs per difficulty for each algorithm. Classification tasks use accuracy and F1; flow and topological-order targets use MAE.

Quirks and pitfalls

Difficulty changes both generator distribution and graph size, so failures cannot be attributed to only one axis. Edge tasks are transformed for some node-token baselines. The old YAML’s 21-million count is the approximate total across seven tasks, not the size of every individual task.

Sources

SOTA Progression

new SOTA matches SOTA at that time other proposed result other baseline result

Leaderboard

#ModelAccuracy ↑Paper
1
Naive multi-task
0.9971
2
Naive single-task
0.9944
3
G-Substrate
0.9841
4
Naive multi-task + interleave
0.9827
5
GITA
0.9817
6
Unified multi-task
0.9809
7
Unified single-task
0.9780
8
G-Wiz
0.9774
SOTA performance set a new SOTA at the time matched the SOTA at the time