Respect the model: Fine-grained and Robust Explanation with Sharing Ratio Decomposition
Sangyu Han, Yearim Kim, Nojun Kwak
Abstract
The truthfulness of existing explanation methods in authentically elucidating the underlying model's decision-making process has been questioned. Existing methods have deviated from faithfully representing the model, thus susceptible to adversarial attacks. To address this, we propose a novel eXplainable AI (XAI) method called SRD (Sharing Ratio Decomposition), which sincerely reflects the model's inference process, resulting in significantly enhanced robustness in our explanations. Different from the conventional emphasis on the neuronal level, we adopt a vector perspective to consider the intricate nonlinear interactions between filters. We also introduce an interesting observation termed Activation-Pattern-Only Prediction (APOP), letting us emphasize the importance of inactive neurons and redefine relevance encapsulating all relevant information including both active and inactive neurons. Our method, SRD, allows for the recursive decomposition of a Pointwise Feature Vector (PFV), providing a high-resolution Effective Receptive Field (ERF) at any layer. * Equal contribution. † Corresponding author. 1 A neuron outputs a scalar, an element in a tensor, by combining the information in its receptive field.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on3
- Concise Explanations of Neural Networks using Adversarial TrainingPrasad Chalasani, Jiefeng Chen, Amrita Roy Chowdhury, Xi Wu et al.ICML 2020 · 148 citations
- CRAFT: Concept Recursive Activation FacTorization for ExplainabilityThomas Fel, Agustin Martin Picard, Louis Béthune, Thibaut Boissin et al.CVPR 2023
- Shortcomings of Top-Down Randomization-Based Sanity Checks for Evaluations of Deep Neural Network ExplanationsAlexander Binder, Leander Weber, Sebastian Lapuschkin, Grégoire Montavon et al.CVPR 2023
Related papers
- Logic Rule Guided Attribution with Dynamic AblationJianqiao An, Yuandu Lai, Yahong HanAAAI 2022 · 4 citations
- What Do You See?: Evaluation of Explainable Artificial Intelligence (XAI) Interpretability through Neural BackdoorsYi-Shan Lin, Wen-Chuan Lee, Z. Berkay CelikKDD 2021 · 62 citations
- Effective Optimization of Root Selection Towards Improved Explanation of Deep ClassifiersXin Zhang, Shenghua Zhong, Jianmin JiangACM MM 2024
- Linear Explanations for Individual NeuronsTuomas P. Oikarinen, Tsui-Wei WengICML 2024 · 18 citations
- Minimizing False-Positive Attributions in Explanations of Non-Linear ModelsAnders Gjølbye, Stefan Haufe, Lars Kai HansenNeurIPS 2025 · 3 citations
