Towards Self-Explainable Graph Neural Network
Abstract
Graph Neural Networks (GNNs), which generalize the deep neural networks to graph-structured data, have achieved great success in modeling graphs. However, as an extension of deep learning for graphs, GNNs lack explainability, which largely limits their adoption in scenarios that demand the transparency of models. Though many efforts are taken to improve the explainability of deep learning, they mainly focus on i.i.d data, which cannot be directly applied to explain the predictions of GNNs because GNNs utilize both node features and graph topology to make predictions. There are only very few work on the explainability of GNNs and they focus on post-hoc explanations. Since post-hoc explanations are not directly obtained from the GNNs, they can be biased and misrepresent the true explanations. Therefore, in this paper, we study a novel problem of self-explainable GNNs which can simultaneously give predictions and explanations. We propose a new framework which can find $K$-nearest labeled nodes for each unlabeled node to give explainable node classification, where nearest labeled nodes are found by interpretable similarity module in terms of both node similarity and local structure similarity. Extensive experiments on real-world and synthetic datasets demonstrate the effectiveness of the proposed framework for explainable node classification.
Benchmark Results
Tested on 3 datasets 4 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 best reported | best at pub: SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels (2017) best today: Understanding Heterophily for Graph Neural Networks (ICML 2024) |
| 39 | SAGE | 0.8911
±0.0012 | |
| 165 | GIN | 0.8660
±0.0091 best reported | best at pub: Learning Conjoint Attentions for Graph Neural Nets (NeurIPS 2021) best today: Large Language Model Meets Graph Neural Network in Knowledge Distillation (AAAI 2024) |
| 480 | SuperGAT | 0.8240
±0.0070 | This paper |
| 584 | Pro-GNN | 0.8130 best reported | |
| 642 | SEGNN | 0.8040
±0.0030 | This paper |
| 702 | GCN-K | 0.7880
±0.0120 | This paper |
| 703 | GIN-K | 0.7880
±0.0030 | This paper |
| 724 | MLP | 0.7768 | |
| 894 | MLP-K | 0.5390
±0.0180 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 44 | GCN | 0.8033
±0.0088 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 61 | GraphSAGE | 0.7923
±0.0053 | |
| 243 | SEGNN | 0.7380
±0.0060 | This paper |
| 263 | SuperGAT | 0.7360
±0.0020 | This paper |
| 294 | Pro-GNN | 0.7330
±0.0070 | This paper |
| 350 | MLP | 0.7289
±0.0010 | |
| 389 | GIN | 0.7250
±0.0080 | prev best: Graph Neural Networks With Convolutional ARMA Filters (2019) |
| 521 | GCN-K | 0.7140
±0.0080 | This paper |
| 645 | GIN-K | 0.6920
±0.0120 | This paper |
| 818 | MLP-K | 0.6160
±0.0160 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 18 | GCN | 0.9296
±0.0015 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 116 | SAGE | 0.8881
±0.0015 | |
| 157 | GIN | 0.8810 best reported | best at pub: Learning Conjoint Attentions for Graph Neural Nets (NeurIPS 2021) best today: UGSL: A Unified Framework for Benchmarking Graph Structure Learning (2023) |
| 210 | MLP | 0.8690
±0.0074 | |
| 454 | SEGNN | 0.8000
±0.0020 | This paper |
| 528 | Pro-GNN | 0.7940
±0.0040 | This paper |
| 562 | SuperGAT | 0.7920
±0.0040 | This paper |
| 618 | GIN-K | 0.7880
±0.0030 | This paper |
| 718 | GCN-K | 0.7740
±0.0020 | This paper |
| 815 | MLP-K | 0.7320
±0.0020 | This paper |
