IJCAI 2019

Node Embedding over Temporal Graphs

Uriel Singer, Ido Guy, Kira Radinsky

Main figure for Node Embedding over Temporal Graphs

Abstract

In this work, we present a method for node embedding in temporal graphs. We propose an algorithm that learns the evolution of a temporal graph's nodes and edges over time and incorporates this dynamics in a temporal node embedding framework for different graph prediction tasks. We present a joint loss function that creates a temporal embedding of a node by learning to combine its historical temporal embeddings, such that it optimizes per given task (e.g., link prediction). The algorithm is initialized using static node embeddings, which are then aligned over the representations of a node at different time points, and eventually adapted for the given task in a joint optimization. We evaluate the effectiveness of our approach over a variety of temporal graphs for the two fundamental tasks of temporal link prediction and multi-label node classification, comparing to competitive baselines and algorithmic alternatives. Our algorithm shows performance improvements across many of the datasets and baselines and is found particularly effective for graphs that are less cohesive, with a lower clustering coefficient.

Proposed method: tNodeEmbed

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

#ModelMicro-F1 ↑Paper
1
LMSPS
0.9566 ±0.0020
2
PSHGCN
0.9561 ±0.0012
3
RpHGNN
0.9555 ±0.0029
21
GCN
0.9460 ±0.0031
52
Node2Vec
actual #52 vs paper #154 102 places worse
0.9282
best reported
actual #52 vs paper #154 102 places worse
paper 0.7520
120
tNodeEmbed
0.8220
This paper
121
TFNM
0.8220
This paper
155
TMFntv
0.7490
This paper
157
TMF
0.7400
This paper
162
CTDNE
0.7170
This paper
165
HTNE
0.7140
This paper
167
dt
0.7110
This paper
176
MLP
0.6447 ±0.0136
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere