Towards Few-shot Self-explaining Graph Neural Networks

Jingyu Peng, Qi Liu, Linan Yue, Zaixin Zhang, Kai Zhang, Yunhao Sha

Main figure for Towards Few-shot Self-explaining Graph Neural Networks

Abstract

Recent advancements in Graph Neural Networks (GNNs) have spurred an upsurge of research dedicated to enhancing the explainability of GNNs, particularly in critical domains such as medicine. A promising approach is the self-explaining method, which outputs explanations along with predictions. However, existing self-explaining models require a large amount of training data, rendering them unavailable in few-shot scenarios. To address this challenge, in this paper, we propose a Meta-learned Self-Explaining GNN (MSE-GNN), a novel framework that generates explanations to support predictions in few-shot settings. MSE-GNN adopts a two-stage self-explaining structure, consisting of an explainer and a predictor. Specifically, the explainer first imitates the attention mechanism of humans to select the explanation subgraph, whereby attention is naturally paid to regions containing important characteristics. Subsequently, the predictor mimics the decision-making process, which makes predictions based on the generated explanation. Moreover, with a novel meta-training process and a designed mechanism that exploits task information, MSE-GNN can achieve remarkable performance on new few-shot tasks. Extensive experimental results on four datasets demonstrate that MSE-GNN can achieve superior performance on prediction tasks while generating high-quality explanations compared with existing methods. The code is publicly available at.

Proposed method: MSE-GNN

Benchmark Results

Tested on 1 dataset Non-standard metric on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

OGB

ogbg-molhiv

Global leaderboard →
Non-default metric. This paper reports AUC-ROC; the dataset default is ROC-AUC. Values below use AUC-ROC only.

Sorted by AUC-ROC. Highlighted rows are from other papers.

#ModelAUC-ROC ↑Paper
1
ASMAML
0.6818 ±0.0080
This paper
2
MSE-GNN
0.6673 ±0.0070
This paper
3
CAL_Meta
0.6580 ±0.0120
This paper
4
GREA_Meta
0.6542 ±0.0050
This paper
5
MAML
0.6538 ±0.0160
This paper
6
CAL_Raw
0.6230 ±0.0080
This paper
7
ProtoNet
0.5540 ±0.0060
This paper
8
GREA_Raw
0.5210 ±0.0090
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper)