KDD 2017

Learning Structural Node Embeddings via Diffusion Wavelets

Claire Donnat, M. Zitnik, David Hallac, J. Leskovec

Main figure for Learning Structural Node Embeddings via Diffusion Wavelets

Abstract

Nodes residing in different parts of a graph can have similar structural roles within their local network topology. The identification of such roles provides key insight into the organization of networks and can be used for a variety of machine learning tasks. However, learning structural representations of nodes is a challenging problem, and it has typically involved manually specifying and tailoring topological features for each node. In this paper, we develop GraphWave, a method that represents each node's network neighborhood via a low-dimensional embedding by leveraging heat wavelet diffusion patterns. Instead of training on hand-selected features, GraphWave learns these embeddings in an unsupervised way. We mathematically prove that nodes with similar network neighborhoods will have similar GraphWave embeddings even though these nodes may reside in very different parts of the network, and our method scales linearly with the number of edges. Experiments in a variety of different settings demonstrate GraphWave's real-world potential for capturing structural roles in networks, and our approach outperforms existing state-of-the-art baselines in every experiment, by as much as 137%.

Proposed method: Diffusion Wavelets

Benchmark Results

Tested on 3 datasets Non-standard metric on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

GraphBench

BA graph

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is MAE. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
Diffusion Wavelets
0.9400
This paper
2
GraphSAGE
0.8500
This paper
3
GCN
0.8200
This paper
4
Node2Vec
0.7800
This paper
5
DeepWalk
0.7500
This paper

ER graph

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is MAE. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
Diffusion Wavelets
0.9300
This paper
2
GraphSAGE
0.8800
This paper
3
GCN
0.8500
This paper
4
Node2Vec
0.7200
This paper
5
DeepWalk
0.7000
This paper

RB graph

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is MAE. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
Diffusion Wavelets
0.8500
This paper
2
GraphSAGE
0.8100
This paper
3
GCN
0.7800
This paper
4
Node2Vec
0.6200
This paper
5
DeepWalk
0.6000
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper)