Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization

Wentao Zhang, Zhi Yang, Yexin Wang, Yu Shen, Yang Li, Liang Wang, Bin Cui

Main figure for Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization

Abstract

Data selection methods, such as active learning and core-set selection, are useful tools for improving the data efficiency of deep learning models on large-scale datasets. However, recent deep learning models have moved forward from independent and identically distributed data to graph-structured data, such as social networks, e-commerce user-item graphs, and knowledge graphs. This evolution has led to the emergence of Graph Neural Networks (GNNs) that go beyond the models existing data selection methods are designed for. Therefore, we present Grain, an efficient framework that opens up a new perspective through connecting data selection in GNNs with social influence maximization. By exploiting the common patterns of GNNs, Grain introduces a novel feature propagation concept, a diversified influence maximization objective with novel influence and diversity functions, and a greedy algorithm with an approximation guarantee into a unified framework. Empirical studies on public datasets demonstrate that Grain significantly improves both the performance and efficiency of data selection (including active learning and core-set selection) for GNNs. To the best of our knowledge, this is the first attempt to bridge two largely parallel threads of research, data selection, and social influence maximization, in the setting of GNNs, paving new ways for improving data efficiency.

Benchmark Results

Tested on 2 datasets Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

Reddit

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is F1. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
GAP-EDP
0.9870 ±0.0003
2
NE-ASGCN
0.9758 ±0.0027
3
HSGT
0.9730 ±0.0024
21
GraphSAGE
0.9653 ±0.0011
98
Grain(NN-D)
0.9250
This paper
106
AGE
0.9160
This paper
108
ANRMAB
0.9150
This paper
109
Degree
0.9140
This paper
112
KCG
0.9130
This paper
113
Random
0.9110
This paper
147
MLP
0.8240 ±0.0010

OGB

#ModelAccuracy ↑Paper
1
SGC
0.7910
2
GAMLP
0.7036 ±0.0002
3
GLEM-GNN
0.7036 ±0.0002
35
SAGE
0.6644 ±0.0017
73
Random
actual #73 vs paper #94 21 places worse
0.6330
best reported
actual #73 vs paper #94 21 places worse
paper 0.5120
paper 0.5120 Δ today 0.1210
91
Grain(ball-D)
0.5290
This paper
93
KCG
0.5160
This paper
94
Degree
0.5150
This paper
95
MLP
0.4960 ±0.0030
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere