graph2vec: Learning Distributed Representations of Graphs

A. Narayanan, Mahinthan Chandramohan, R. Venkatesan, Lihui Chen, Yang Liu, Shantanu Jaiswal

Main figure for graph2vec: Learning Distributed Representations of Graphs

Abstract

Recent works on representation learning for graph structured data predominantly focus on learning distributed representations of graph substructures such as nodes and subgraphs. However, many graph analytics tasks such as graph classification and clustering require representing entire graphs as fixed length feature vectors. While the aforementioned approaches are naturally unequipped to learn such representations, graph kernels remain as the most effective way of obtaining them. However, these graph kernels use handcrafted features (e.g., shortest paths, graphlets, etc.) and hence are hampered by problems such as poor generalization. To address this limitation, in this work, we propose a neural embedding framework named graph2vec to learn data-driven distributed representations of arbitrary sized graphs. graph2vec's embeddings are learnt in an unsupervised manner and are task agnostic. Hence, they could be used for any downstream task such as graph classification, clustering and even seeding supervised representation learning approaches. Our experiments on several benchmark and large real-world datasets show that graph2vec achieves significant improvements in classification and clustering accuracies over substructure representation learning approaches and are competitive with state-of-the-art graph kernels.

Proposed method: graph2vec

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9410 ±0.0330
2
GRDL
0.8260 ±0.0120
3
GMN
0.8225
32
GIN
0.7880 ±0.0410
149
MLP
0.7600 ±0.0320
252
WL kernel
actual #252 vs paper #369 117 places worse
0.7500 ±0.0310
best reported
actual #252 vs paper #369 117 places worse
paper 0.7292 ±0.0056

Difference within reported uncertainty; not counted as underperformance.

paper 0.7292 ±0.0056 Δ today 0.0208
350
graph2vec
0.7330 ±0.0205
This paper
352
Deep WL kernel
0.7330 ±0.0082
This paper
515
nv
0.5749 ±0.0357
This paper
518
sv
0.5303 ±0.0555
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers)