L2XGNN: Learning to Explain Graph Neural Networks

G. Serra, Mathias Niepert

Main figure for L2XGNN: Learning to Explain Graph Neural Networks

Abstract

Graph Neural Networks (GNNs) are a popular class of machine learning models. Inspired by the learning to explain (L2X) paradigm, we propose L2XGNN, a framework for explainable GNNs which provides faithful explanations by design. L2XGNN learns a mechanism for selecting explanatory subgraphs (motifs) which are exclusively used in the GNNs message-passing operations. L2XGNN is able to select, for each input graph, a subgraph with specific properties such as being sparse and connected. Imposing such constraints on the motifs often leads to more interpretable and effective explanations. Experiments on several datasets suggest that L2XGNN achieves the same classification accuracy as baseline methods using the entire input graph while ensuring that only the provided explanations are used to make predictions. Moreover, we show that L2XGNN is able to identify motifs responsible for the graph's properties it is intended to predict.

Benchmark Results

Tested on 1 dataset 3 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
actual #39 vs paper #534 495 places worse
0.9330 ±0.0290
best reported
actual #39 vs paper #534 495 places worse
paper 0.8270 ±0.0510
paper 0.8270 ±0.0510 Δ at pub 0.1060
63
GCN
actual #63 vs paper #734 671 places worse
0.9220 ±0.0440
best reported
actual #63 vs paper #734 671 places worse
paper 0.7360 ±0.0290
paper 0.7360 ±0.0290 Δ at pub 0.1550 Δ today 0.1860
158
GraphSAGE
actual #158 vs paper #721 563 places worse
0.9040 ±0.0780
best reported
actual #158 vs paper #721 563 places worse
paper 0.7440 ±0.0400
paper 0.7440 ±0.0400 Δ at pub 0.1600
403
MLP
0.8660 ±0.0495
549
L2xGin
0.8250 ±0.0780
This paper
585
L2xGin_dsc
0.8140 ±0.0920
This paper
627
L2xGsg
0.7980 ±0.0810
This paper
692
L2xGsg_dsc
0.7610 ±0.0280
This paper
709
L2xGcn
0.7530 ±0.0410
This paper
718
SAGE
0.7490 ±0.0870
725
L2xGcn_dsc
0.7420 ±0.0350
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green)