Finding Interpretable Class-Specific Patterns through Efficient Neural Search
Nils Philipp Walter, Jonas Fischer, Jilles Vreeken
Abstract
Discovering patterns in data that best describe the differences between classes allows to hypothesize and reason about class-specific mechanisms. In molecular biology, for example, these bear the promise of advancing the understanding of cellular processes differing between tissues or diseases, which could lead to novel treatments. To be useful in practice, methods that tackle the problem of finding such differential patterns have to be readily interpretable by domain experts, and scalable to the extremely high-dimensional data.
In this work, we propose a novel, inherently interpretable binary neural network architecture Diffnaps that extracts differential patterns from data. Diffnaps is scalable to hundreds of thousands of features and robust to noise, thus overcoming the limitations of current state-of-the-art methods in large-scale applications such as in biology. We show on synthetic and real world data, including three biological applications, that unlike its competitors, Diffnaps consistently yields accurate, succinct, and interpretable class descriptions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 30a4fdf1-7fbb-42e6-841a-c4d912a170f0Cited by top-tier papers4
- HyperLogic: Enhancing Diversity and Accuracy in Rule Learning with HyperNetsYang Yang, Wendi Ren, Shuang LiNeurIPS 2024 · 9 citations
- Learning Exceptional Subgroups by End-to-End Maximizing KL-DivergenceSascha Xu, Nils Philipp Walter, Janis Kalofolias, Jilles VreekenICML 2024 · 8 citations
- Neural Rule Lists: Learning Discretizations, Rules, and Order in One GoSascha Xu, Nils Philipp Walter, Jilles VreekenNeurIPS 2025 · 2 citations
- Differentiable Rule Induction from Raw Sequence InputsKun Gao, Katsumi Inoue, Yongzhi Cao, Hanpin Wang et al.ICLR 2025
Builds on7
- Generalized and Scalable Optimal Sparse Decision TreesJimmy Lin, Chudi Zhong, Diane Hu, Cynthia Rudin et al.ICML 2020 · 174 citations
- Scalable Rule-Based Representation Learning for Interpretable ClassificationZhuo Wang, Wei Zhang, Ning Liu, Jianyong WangNeurIPS 2021 · 87 citations
- Fast Sparse Decision Tree Optimization via Reference EnsemblesHayden McTavish, Chudi Zhong, Reto Achermann, Ilias Karimalis et al.AAAI 2022 · 55 citations
- Transparent Classification with Multilayer Logical Perceptrons and Random BinarizationZhuo Wang, Wei Zhang, Ning Liu, Jianyong WangAAAI 2020 · 37 citations
- Label-Descriptive Patterns and Their Application to Characterizing Classification ErrorsMichael A. Hedderich, Jonas Fischer, Dietrich Klakow, Jilles VreekenICML 2022 · 14 citations
Related papers
- Differentiable Pattern Set MiningJonas Fischer, Jilles VreekenKDD 2021 · 10 citations
- Neural-based classification rule learning for sequential dataMarine Collery, Philippe Bonnard, François Fages, Remy KustersICLR 2023
- What's in the Box? Exploring the Inner Life of Neural Networks with Robust RulesJonas Fischer, Anna Oláh, Jilles VreekenICML 2021 · 11 citations
- Interpretable Neural ODEs for Gene Regulatory Network Discovery under PerturbationsZaikang Lin, Sei Chang, Aaron Zweig, Minseo Kang et al.ICML 2026 · 8 citations
- A Functional Extension of Semi-Structured NetworksDavid Rügamer, Bernard X. W. Liew, Zainab Altai, Almond StöckerNeurIPS 2024
