NeurIPS 2022

Graph Few-shot Learning with Task-specific Structures

Song Wang, Chen Chen, Jundong Li

Main figure for Graph Few-shot Learning with Task-specific Structures

Abstract

Graph few-shot learning is of great importance among various graph learning tasks. Under the few-shot scenario, models are often required to conduct classification given limited labeled samples. Existing graph few-shot learning methods typically leverage Graph Neural Networks (GNNs) and perform classification across a series of meta-tasks. Nevertheless, these methods generally rely on the original graph (i.e., the graph that the meta-task is sampled from) to learn node representations. Consequently, the graph structure used in each meta-task is identical. Since the class sets are different across meta-tasks, node representations should be learned in a task-specific manner to promote classification performance. Therefore, to adaptively learn node representations across meta-tasks, we propose a novel framework that learns a task-specific structure for each meta-task. To handle the variety of nodes across meta-tasks, we extract relevant nodes and learn task-specific structures based on node influence and mutual information. In this way, we can learn node representations with the task-specific structure tailored for each meta-task. We further conduct extensive experiments on five node classification datasets under both single- and multiple-graph settings to validate the superiority of our framework over the state-of-the-art baselines. Our code is provided at https://github.com/SongW-SW/GLITTER.

Proposed method: GLITTER

Benchmark Results

Tested on 1 dataset Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

DBLP

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is Micro-F1. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
HG-SCM
0.9490 ±0.0015
2
SeHGNN
0.9489 ±0.0018
3
AdvSynGNN
0.9486 ±0.0012
36
GCN
0.8758 ±0.0020
65
MLP
0.8118 ±0.0020
77
GLITTER
0.7930 ±0.0310
This paper
99
GPN
0.7540 ±0.0230
This paper
102
RALE
0.7490 ±0.0320
This paper
108
G-Meta
0.7310 ±0.0340
This paper
116
Meta-GNN
0.6640 ±0.0280
This paper
119
KNN
0.6340 ±0.0330
This paper
123
MAML
0.6040 ±0.0450
This paper
124
ProtoNet
0.5850 ±0.0260
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers)