FAME: Formal Abstract Minimal Explanation for Neural Networks
Ryma Boumazouza, Raya Elsaleh, Melanie Ducoffe, Shahaf Bassan, Guy Katz
Abstract
We propose (Formal Abstract Minimal Explanations), a new class of abductive explanations grounded in abstract interpretation. FAME is the first method to scale to large neural networks while reducing explanation size. Our main contribution is the design of dedicated perturbation domains that eliminate the need for traversal order. FAME progressively shrinks these domains and leverages LiRPA-based bounds to discard irrelevant features, ultimately converging to a . To assess explanation quality, we introduce a procedure that measures the worst-case distance between an abstract minimal explanation and a true minimal explanation. This procedure combines adversarial attacks with an optional refinement step. We benchmark FAME against and demonstrate consistent gains in both explanation size and runtime on medium- to large-scale neural networks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ec3cd093-9dbe-4f24-b85e-d4d059166febCited by top-tier papers3
- Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable GuaranteesItamar Hadad, Guy Katz, Shahaf BassanICLR 2026 · 10 citations
- Provably Explaining Neural Additive ModelsShahaf Bassan, Yizhak Yisrael Elboher, Tobias Ladner, Volkan Şahin et al.ICLR 2026 · 3 citations
- Unifying Formal Explanations: A Complexity-Theoretic PerspectiveShahaf Bassan, Xuanxiang Huang, Guy KatzICLR 2026 · 3 citations
Builds on14
- Automatic Perturbation Analysis for Scalable Certified Robustness and BeyondKaidi Xu, Zhouxing Shi, Huan Zhang, Yihan Wang et al.NeurIPS 2020 · 415 citations
- Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Neural Network Robustness VerificationShiqi Wang, Huan Zhang, Kaidi Xu, Xue Lin et al.NeurIPS 2021 · 359 citations
- Efficient Verification of ReLU-Based Neural Networks via Dependency AnalysisElena Botoeva, Panagiotis Kouvaros, Jan Kronqvist, Alessio Lomuscio et al.AAAI 2020 · 140 citations
- Explaining Naive Bayes and Other Linear Classifiers with Polynomial Time and DelayJoão Marques-Silva, Thomas Gerspacher, Martin C. Cooper, Alexey Ignatiev et al.NeurIPS 2020 · 86 citations
- Using MaxSAT for Efficient Explanations of Tree EnsemblesAlexey Ignatiev, Yacine Izza, Peter J. Stuckey, João Marques-SilvaAAAI 2022 · 75 citations
Related papers
- Explaining, Fast and Slow: Abstraction and Refinement of Provable ExplanationsShahaf Bassan, Yizhak Yisrael Elboher, Tobias Ladner, Matthias Althoff et al.ICML 2025
- Verified SHAP: Provable Bounds for Exact Shapley Values of Neural NetworksDavid Boetius, Shahaf Bassan, Guy Katz, Stefan Leue et al.ICML 2026
- FIMAP: Feature Importance by Minimal Adversarial PerturbationMatt Chapman-Rounds, Umang Bhatt, Erik Pazos, Marc-Andre Schulz et al.AAAI 2021 · 14 citations
- Robust Explanation Constraints for Neural NetworksMatthew Wicker, Juyeon Heo, Luca Costabello, Adrian WellerICLR 2023 · 3 citations
- Don't Lie to Me! Robust and Efficient Explainability with Verified Perturbation AnalysisThomas Fel, Melanie Ducoffe, David Vigouroux, Rémi Cadène et al.CVPR 2023
