GraphBench
Algorithmic Reasoning
Structure
21,420,000Graphs
Coverage
8Results
1Variants
Mixed node/edge/graph prediction suite covering topological sorting, maximum flow, MST, bridges, Steiner tree, maximum clique, and matching with task-specific node, edge, or graph targets. Evaluated by Accuracy.
Dataset details
Task
Simulate seven graph algorithms through node regression, node classification, or edge classification: topological sorting, maximum flow, minimum spanning tree, bridge finding, Steiner tree, maximum clique, and maximum matching.
Data
Each algorithm has easy, medium, and hard synthetic datasets whose train and test graphs differ in generator distribution. Training graphs have 16 nodes while held-out graphs include 128 nodes, with additional size-generalization tests up to 512 nodes in the published experiments.
Features
Inputs encode the graph, algorithm-specific weights or designated vertices, and task-relevant node or edge attributes. Unlike CLRS-style processor supervision, these datasets focus on final outputs rather than providing a full sequence of algorithmic hints.
Splits and evaluation
Fixed 98%/1%/1% splits contain about one million graphs per difficulty for each algorithm. Classification tasks use accuracy and F1; flow and topological-order targets use MAE.
Quirks and pitfalls
Difficulty changes both generator distribution and graph size, so failures cannot be attributed to only one axis. Edge tasks are transformed for some node-token baselines. The old YAML’s 21-million count is the approximate total across seven tasks, not the size of every individual task.
Sources
SOTA Progression
new SOTA
matches SOTA at that time
other proposed result
other baseline result
Leaderboard
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | Naive multi-task | 0.9971 | |
| 2 | Naive single-task | 0.9944 | |
| 3 | G-Substrate | 0.9841 | |
| 4 | Naive multi-task + interleave | 0.9827 | |
| 5 | GITA | 0.9817 | |
| 6 | Unified multi-task | 0.9809 | |
| 7 | Unified single-task | 0.9780 | |
| 8 | G-Wiz | 0.9774 |
SOTA performance
set a new SOTA at the time
matched the SOTA at the time