Towards Self-Explainable Graph Neural Network

Enyan Dai, Suhang Wang

Main figure for Towards Self-Explainable Graph Neural Network

Abstract

Graph Neural Networks (GNNs), which generalize the deep neural networks to graph-structured data, have achieved great success in modeling graphs. However, as an extension of deep learning for graphs, GNNs lack explainability, which largely limits their adoption in scenarios that demand the transparency of models. Though many efforts are taken to improve the explainability of deep learning, they mainly focus on i.i.d data, which cannot be directly applied to explain the predictions of GNNs because GNNs utilize both node features and graph topology to make predictions. There are only very few work on the explainability of GNNs and they focus on post-hoc explanations. Since post-hoc explanations are not directly obtained from the GNNs, they can be biased and misrepresent the true explanations. Therefore, in this paper, we study a novel problem of self-explainable GNNs which can simultaneously give predictions and explanations. We propose a new framework which can find $K$-nearest labeled nodes for each unlabeled node to give explainable node classification, where nearest labeled nodes are found by interpretable similarity module in terms of both node similarity and local structure similarity. Extensive experiments on real-world and synthetic datasets demonstrate the effectiveness of the proposed framework for explainable node classification.

Proposed method: SEGNN

Benchmark Results

Tested on 3 datasets 4 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
actual #21 vs paper #618 597 places worse
0.9004
best reported
actual #21 vs paper #618 597 places worse
paper 0.8080 ±0.0110
paper 0.8080 ±0.0110 Δ at pub 0.0637 Δ today 0.0924
39
SAGE
0.8911 ±0.0012
165
GIN
actual #165 vs paper #631 466 places worse
0.8660 ±0.0091
best reported
actual #165 vs paper #631 466 places worse
paper 0.8050 ±0.0080
paper 0.8050 ±0.0080 Δ at pub 0.0108 Δ today 0.0610
480
SuperGAT
0.8240 ±0.0070
This paper
584
Pro-GNN
actual #584 vs paper #692 108 places worse
0.8130
best reported
actual #584 vs paper #692 108 places worse
paper 0.7910 ±0.0010
642
SEGNN
0.8040 ±0.0030
This paper
702
GCN-K
0.7880 ±0.0120
This paper
703
GIN-K
0.7880 ±0.0030
This paper
724
MLP
0.7768
894
MLP-K
0.5390 ±0.0180
This paper
#ModelAccuracy ↑Paper
1
CNA
0.9575 ±0.0058
2
IS-GIB
0.9390 ±0.0187
3
EERM
0.9112 ±0.0145
44
GCN
actual #44 vs paper #463 419 places worse
0.8033 ±0.0088
best reported
actual #44 vs paper #463 419 places worse
paper 0.7190 ±0.0100
61
GraphSAGE
0.7923 ±0.0053
243
SEGNN
0.7380 ±0.0060
This paper
263
SuperGAT
0.7360 ±0.0020
This paper
294
Pro-GNN
0.7330 ±0.0070
This paper
350
MLP
0.7289 ±0.0010
389
GIN
actual #389 vs paper #389
0.7250 ±0.0080
actual #389 vs paper #389
paper 0.7250 ±0.0080
paper 0.7250 ±0.0080 Δ at pub 0.0940
521
GCN-K
0.7140 ±0.0080
This paper
645
GIN-K
0.6920 ±0.0120
This paper
818
MLP-K
0.6160 ±0.0160
This paper
#ModelAccuracy ↑Paper
1
LGTL
0.9518 ±0.0011
2
MixHop (LO)
0.9513 ±0.0038
3
GraphSAGE (LO)
0.9511 ±0.0036
18
GCN
actual #18 vs paper #646 628 places worse
0.9296 ±0.0015
best reported
actual #18 vs paper #646 628 places worse
paper 0.7840 ±0.0040
116
SAGE
0.8881 ±0.0015
157
GIN
actual #157 vs paper #602 445 places worse
0.8810
best reported
actual #157 vs paper #602 445 places worse
paper 0.7890 ±0.0020
paper 0.7890 ±0.0020 Δ at pub 0.0186 Δ today 0.0920
210
MLP
0.8690 ±0.0074
454
SEGNN
0.8000 ±0.0020
This paper
528
Pro-GNN
0.7940 ±0.0040
This paper
562
SuperGAT
0.7920 ±0.0040
This paper
618
GIN-K
0.7880 ±0.0030
This paper
718
GCN-K
0.7740 ±0.0020
This paper
815
MLP-K
0.7320 ±0.0020
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere