Incorporating probabilistic domain knowledge into deep multiple instance learning
Ghadi S. Al Hajj, Aliaksandr Hubin, Chakravarthi Kanduri, Milena Pavlovic, Knut Dagestad Rand, Michael Widrich, Anne H. Schistad Solberg, Victor Greiff, Johan Pensar, Günter Klambauer, Geir Kjetil Sandve
Abstract
Deep learning methods, including deep multiple instance learning methods, have been criticized for their limited ability to incorporate domain knowledge. A reason that knowledge incorporation is challenging in deep learning is that the models usually lack a mapping between their model components and the entities of the domain, making it a non-trivial task to incorporate probabilistic prior information. In this work, we show that such a mapping between domain entities and model components can be defined for a multiple instance learning setting and propose a framework DeeMILIP that encompasses multiple strategies to exploit this mapping for prior knowledge incorporation. We motivate and formalize these strategies from a probabilistic perspective. Experiments on an immune-based diagnostics case show that our proposed strategies allow to learn generalizable models even in settings with weak signals, limited dataset size, and limited compute.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c90fba4e-4324-485c-9e0c-539d4fbb1883Cited by top-tier papers1
Ask how each one uses itBuilds on5
- Modern Hopfield Networks and Attention for Immune Repertoire ClassificationMichael Widrich, Bernhard Schäfl, Milena Pavlovic, Hubert Ramsauer et al.NeurIPS 2020 · 152 citations
- Additive MIL: Intrinsically Interpretable Multiple Instance Learning for PathologySyed Ashar Javed, Dinkar Juyal, Harshith Padigela, Amaro Taylor-Weiner et al.NeurIPS 2022 · 124 citations
- Inherently Interpretable Time Series Classification via Multiple Instance LearningJoseph Early, Gavin K. C. Cheung, Kurt Cutajar, Hanting Xie et al.ICLR 2024 · 29 citations
- On Translation Invariance in CNNs: Convolutional Layers Can Exploit Absolute Spatial LocationOsman Semih Kayhan, Jan C. van GemertCVPR 2020
- Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive LearningKangning Liu, Weicheng Zhu, Yiqiu Shen, Sheng Liu et al.CVPR 2023
Related papers
- xMIL: Insightful Explanations for Multiple Instance Learning in HistopathologyJulius Hense, Mina Jamshidi Idaji, Oliver Eberle, Thomas Schnake et al.NeurIPS 2024 · 26 citations
- DearLLM: Enhancing Personalized Healthcare via Large Language Models-Deduced Feature CorrelationsYongxin Xu, Xinke Jiang, Xu Chu, Rihong Qiu et al.AAAI 2025 · 7 citations
- Bayes-MIL: A New Probabilistic Perspective on Attention-based Multiple Instance Learning for Whole Slide ImagesYufei Cui, Ziquan Liu, Xiangyu Liu, Xue Liu et al.ICLR 2023
- Reproducibility in Multiple Instance Learning: A Case For Algorithmic Unit TestsEdward Raff, James HoltNeurIPS 2023 · 16 citations
- Are Multiple Instance Learning Algorithms Learnable for Instances?Jaeseok Jang, Hyuk-Yoon KwonNeurIPS 2024 · 13 citations
