Attributed Network Embedding for Learning in a Dynamic Environment

Jundong Li, Harsh Dani, Xia Hu, Jiliang Tang, Yi Chang, Huan Liu

Main figure for Attributed Network Embedding for Learning in a Dynamic Environment

Abstract

Network embedding leverages the node proximity manifested to learn a low-dimensional node vector representation for each node in the network. The learned embeddings could advance various learning tasks such as node classification, network clustering, and link prediction. Most, if not all, of the existing works, are overwhelmingly performed in the context of plain and static networks. Nonetheless, in reality, network structure often evolves over time with addition/deletion of links and nodes. Also, a vast majority of real-world networks are associated with a rich set of node attributes, and their attribute values are also naturally changing, with the emerging of new content patterns and the fading of old content patterns. These changing characteristics motivate us to seek an effective embedding representation to capture network and attribute evolving patterns, which is of fundamental importance for learning in a dynamic environment. To our best knowledge, we are the first to tackle this problem with the following two challenges: (1) the inherently correlated network and node attributes could be noisy and incomplete, it necessitates a robust consensus representation to capture their individual properties and correlations; (2) the embedding learning needs to be performed in an online fashion to adapt to the changes accordingly. In this paper, we tackle this problem by proposing a novel dynamic attributed network embedding framework - DANE. In particular, DANE first provides an offline method for a consensus embedding and then leverages matrix perturbation theory to maintain the freshness of the end embedding results in an online manner. We perform extensive experiments on both synthetic and real attributed networks to corroborate the effectiveness and efficiency of the proposed framework.

Benchmark Results

Tested on 1 dataset Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

DBLP

Global leaderboard →
Non-default metric. This paper reports ACC; the dataset default is Micro-F1. Values below use ACC only.

Sorted by ACC. Highlighted rows are from other papers.

#ModelACC ↑Paper
1
DANE-O
0.7721
This paper
2
DANE
0.7664
This paper
3
SELENE
0.7574
5
DeepWalk
0.7438
This paper
7
LINE
0.7297
This paper
8
LANE
0.7215
This paper
9
DANE-N
0.7199
This paper
10
LCMF
0.6971
This paper
13
DANE-A
0.6392
This paper
20
SAGE
0.4868
22
CCA
0.4567
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers)