Towards Prototype-Based Self-Explainable Graph Neural Network

Enyan Dai, Suhang Wang

Main figure for Towards Prototype-Based Self-Explainable Graph Neural Network

Abstract

Graph Neural Networks (GNNs) have shown great ability in modeling graph-structured data for various domains. However, GNNs are known as black-box models that lack interpretability. Without understanding their inner working, we cannot fully trust them, which largely limits their adoption in high-stake scenarios. Though some initial efforts have been taken to interpret the predictions of GNNs, they mainly focus on providing post-hoc explanations using an additional explainer, which could misrepresent the true inner working mechanism of the target GNN. The works on self-explainable GNNs are rather limited. Therefore, we study a novel problem of learning prototype-based self-explainable GNNs that can simultaneously give accurate predictions and prototype-based explanations on predictions. We design a framework which can learn prototype graphs that capture representative patterns of each class as class-level explanations. The learned prototypes are also used to simultaneously make prediction for for a test instance and provide instance-level explanation. Extensive experiments on real-world and synthetic datasets show the effectiveness of the proposed framework for both prediction accuracy and explanation quality.

Proposed method: novel Prototype-Based Self-Explainable GNN

Benchmark Results

Tested on 1 dataset 2 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
actual #18 vs paper #646 628 places worse
0.9296 ±0.0015
best reported
actual #18 vs paper #646 628 places worse
paper 0.7840 ±0.0040
116
SAGE
0.8881 ±0.0015
157
GIN
actual #157 vs paper #721 564 places worse
0.8810
best reported
actual #157 vs paper #721 564 places worse
paper 0.7730 ±0.0060
paper 0.7730 ±0.0060 Δ at pub 0.0346 Δ today 0.1080
210
MLP
0.8690 ±0.0074
512
novel Prototype-Based Self-Explainable GNN
0.7950 ±0.0120
This paper
564
SE-GNN
0.7920 ±0.0070
This paper
793
ProtGNN
0.7530 ±0.0120
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green)