ICLR 2024

Node-Time Conditional Prompt Learning in Dynamic Graphs

Xingtong Yu, Zhenghao Liu, Xinming Zhang, Yuan Fang

Main figure for Node-Time Conditional Prompt Learning in Dynamic Graphs

Abstract

Dynamic graphs capture evolving interactions between entities, such as in social networks, online learning platforms, and crowdsourcing projects. For dynamic graph modeling, dynamic graph neural networks (DGNNs) have emerged as a mainstream technique. However, they are generally pre-trained on the link prediction task, leaving a significant gap from the objectives of downstream tasks such as node classification. To bridge the gap, prompt-based learning has gained traction on graphs, but most existing efforts focus on static graphs and neglect the evolution of dynamic graphs. In this paper, we propose, a novel pre-training and prompt learning framework for dynamic graph modeling. First, we design dual prompts to address the discrepancy in both task objectives and temporal variations across pre-training and downstream tasks. Second, we recognize that node and time patterns often characterize each other, and propose dual condition-nets to model the evolving node-time patterns in downstream tasks. Finally, we thoroughly evaluate and analyze \ through extensive experiments on four public datasets.

Benchmark Results

Tested on 1 dataset Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

Reddit

Global leaderboard →
Non-default metric. This paper reports AUC-ROC; the dataset default is F1. Values below use AUC-ROC only.

Sorted by AUC-ROC. Highlighted rows are from other papers.

#ModelAUC-ROC ↑Paper
1
TGN-DyGPrompt
0.7400 ±0.0310
This paper
2
TGAT-DyGPrompt
0.7350 ±0.0647
This paper
3
ProG
0.6860 ±0.0564
This paper
4
TGAT-TIGPrompt
0.6770 ±0.0964
This paper
5
CPDG
0.6592 ±0.0625
This paper
6
TREND
0.6485 ±0.0471
This paper
7
TGN-TIGPrompt
0.6375 ±0.0560
This paper
8
GraphPrompt
0.6089 ±0.0637
This paper
9
GraphMixer
0.6021 ±0.0536
This paper
10
DDGCL
0.5521 ±0.0619
This paper
11
TGAT
0.5364 ±0.0550
This paper
12
TGN
0.4954 ±0.0623
This paper
13
GCN-ROLAND
0.4825 ±0.0957
This paper
14
GAT-ROLAND
0.4795 ±0.0842
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper)