Efficient GNN Explanation via Learning Removal-based Attribution

Yao Rong, Guanchu Wang, Qizhang Feng, Ninghao Liu, Zirui Liu, Enkelejda Kasneci, Xia Hu

Main figure for Efficient GNN Explanation via Learning Removal-based Attribution

Abstract

As Graph Neural Networks (GNNs) have been widely used in real-world applications, model explanations are required not only by users but also by legal regulations. However, simultaneously achieving high fidelity and low computational costs in generating explanations has been a challenge for current methods. In this work, we propose a framework of GNN explanation named to address this problem. Specifically, we introduce removal-based attribution and demonstrate its substantiated link to interpretability fidelity theoretically and experimentally. The explainer in learns to generate removal-based attribution which enables providing explanations with high fidelity. A strategy of subgraph sampling is designed in to improve the scalability of the training process. In the deployment, can efficiently generate the explanation through a feed-forward pass. We benchmark our approach with other state-of-the-art GNN explanation methods on six datasets. Results highlight the effectiveness of our framework regarding both efficiency and fidelity. In particular, is 3.5$ $ faster and achieves higher fidelity than the state-of-the-art method on the large dataset ogbn-arxiv (more than 160K nodes and 1M edges), showing its great potential in real-world applications. Our source code is available at.

Proposed method: MI

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

TU Dortmund

#ModelAccuracy ↑Paper
1
MSH-GNN
0.9910 ±0.0030
2
ID-GNN+BEC
0.9830 ±0.0360
3
SupCosine
0.9830 ±0.0250
39
GIN
0.9330 ±0.0290
214
MI
actual #214 vs paper #589 375 places worse
0.8970 ±0.0110
best reported
actual #214 vs paper #589 375 places worse
paper 0.8100
paper 0.8100 Δ at pub 0.0870
403
MLP
0.8660 ±0.0495
SOTA performance (not significantly different from the best) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green)