Graph Prototypical Networks for Few-shot Learning on Attributed Networks

Kaize Ding, Jianling Wang, Jundong Li, Kai Shu, Chenghao Liu, Huan Liu

Main figure for Graph Prototypical Networks for Few-shot Learning on Attributed Networks

Abstract

Attributed networks nowadays are ubiquitous in a myriad of high-impact applications, such as social network analysis, financial fraud detection, and drug discovery. As a central analytical task on attributed networks, node classification has received much attention in the research community. In real-world attributed networks, a large portion of node classes only contains limited labeled instances, rendering a long-tail node class distribution. Existing node classification algorithms are unequipped to handle the few-shot node classes. As a remedy, few-shot learning has attracted a surge of attention in the research community. Yet, few-shot node classification remains a challenging problem as we need to address the following questions: (i) How to extract meta-knowledge from an attributed network for few-shot node classification? (ii) How to identify the informativeness of each labeled instance for building a robust and effective model? To answer these questions, in this paper, we propose a graph meta-learning framework -- Graph Prototypical Networks (GPN). By constructing a pool of semi-supervised node classification tasks to mimic the real test environment, GPN is able to perform meta-learning on an attributed network and derive a highly generalizable model for handling the target classification task. Extensive experiments demonstrate the superior capability of GPN in few-shot node classification.

Proposed method: GPN

Benchmark Results

Tested on 1 dataset Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterophily Benchmark

Amazon-ratings

Global leaderboard →
Non-default metric. This paper reports ACC; the dataset default is Accuracy. Values below use ACC only.

Sorted by ACC. Highlighted rows are from other papers.

#ModelACC ↑Paper
1
GPN
0.7860
This paper
2
Meta-GNN
0.7730
This paper
3
MAML
0.6610
This paper
4
PN
0.6350
This paper
5
SGC
0.6220
This paper
6
GCN
0.5930
This paper
7
DeepWalk
0.4650
This paper
8
Node2Vec
0.4190
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper)