Explaining Object Detectors via Collective Contribution of Pixels
Toshinori Yamauchi, Hiroshi Kera, Kazuhiko Kawamoto
Abstract
Visual explanations for object detectors are crucial for enhancing their reliability. Object detectors identify and localize instances by assessing multiple visual features collectively. When generating explanations, overlooking these collective influences in detections may lead to missing compositional cues or capturing spurious correlations. However, existing methods typically focus solely on individual pixel contributions, neglecting the collective contribution of multiple pixels. To address this limitation, we propose a game-theoretic method based on Shapley values and interactions to explicitly capture both individual and collective pixel contributions. Our method provides explanations for both bounding box localization and class determination, highlighting regions crucial for detection. Extensive experiments demonstrate that the proposed method identifies important regions more accurately than state-of-the-art methods. The code is available at https://github.com/ tttt-0814/VX-CODE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- PhaseWin Search Framework Enable Efficient Object-Level InterpretationZihan Gu, Ruoyu Chen, Junchi Zhang, Yue Hu et al.CVPR 2026 · 1 citation
- H-Sets: Hessian-Guided Discovery of Set-Level Feature Interactions in Image ClassifiersAyushi Mehrotra, Dipkamal Bhusal, Michael Clifford, Nidhi RastogiCVPR 2026 · 1 citation
- Interpreting Object-level Foundation Models via Visual Precision SearchRuoyu Chen, Siyuan Liang, Jingzhi Li, Shiming Liu et al.CVPR 2025
Builds on12
- FCOS: Fully Convolutional One-Stage Object DetectionZhi Tian, Chunhua Shen, Hao Chen, Tong HeICCV 2019 · 6,042 citations
- Do Vision Transformers See Like Convolutional Neural Networks?Maithra Raghu, Thomas Unterthiner, Simon Kornblith, Chiyuan Zhang et al.NeurIPS 2021 · 1,553 citations
- The Many Shapley Values for Model ExplanationMukund Sundararajan, Amir NajmiICML 2020 · 799 citations
- FastSHAP: Real-Time Shapley Value EstimationNeil Jethani, Mukund Sudarshan, Ian Connick Covert, Su-In Lee et al.ICLR 2022 · 186 citations
- Towards Better Explanations of Class Activation MappingHyungsik Jung, Youngrock OhICCV 2021 · 109 citations
Related papers
- Identifying Important Group of Pixels using InteractionsKosuke Sumiyasu, Kazuhiko Kawamoto, Hiroshi KeraCVPR 2024
- Problems with Shapley-value-based explanations as feature importance measuresI. Elizabeth Kumar, Suresh Venkatasubramanian, Carlos Scheidegger, Sorelle A. FriedlerICML 2020 · 458 citations
- Towards Fine-Grained Interpretability: Counterfactual Explanations for Misclassification with Saliency PartitionLintong Zhang, Kang Yin, Seong-Whan LeeCVPR 2025
- Towards Attributions of Input Variables in a CoalitionXinhao Zheng, Huiqi Deng, Quanshi ZhangICML 2025
- Explaining Probabilistic Models with Distributional ValuesLuca Franceschi, Michele Donini, Cédric Archambeau, Matthias W. SeegerICML 2024 · 4 citations
