Credal Prediction based on Relative Likelihood
Timo Löhr, Paul Hofman, Felix Mohr, Eyke Hüllermeier
Abstract
Predictions in the form of sets of probability distributions, so-called credal sets, provide a suitable means to represent a learner's epistemic uncertainty. In this paper, we propose a theoretically grounded approach to credal prediction based on the statistical notion of relative likelihood: The target of prediction is the set of all (conditional) probability distributions produced by the collection of plausible models, namely those models whose relative likelihood exceeds a specified threshold. This threshold has an intuitive interpretation and allows for controlling the trade-off between correctness and precision of credal predictions. We tackle the problem of approximating credal sets defined in this way by means of suitably modified ensemble learning techniques. To validate our approach, we illustrate its effectiveness by experiments on benchmark datasets demonstrating superior uncertainty representation without compromising predictive performance. We also compare our method against several state-of-the-art baselines in credal prediction. * * equal contribution 39th Conference on Neural Information Processing Systems (NeurIPS 2025). Credal Relative Likelihood (CreRL ) 𝛂 Entailed Contradicted Neutral Entailed Contradicted Neutral
"Three boys wearing life jackets are on top of an innertube in the water."
"Three boys are swimming.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 95bd34e1-3bbd-4a24-b8af-6b79404849ebCited by top-tier papers3
- Learning Credal Ensembles via Distributionally Robust OptimizationKaizheng Wang, Ghifari Adam Faza, Fabio Cuzzolin, Siu Lun Chau et al.ICML 2026 · 3 citations
- Possibilistic Predictive Uncertainty for Deep LearningYao Ni, Jeremie Houssineau, Yew Soon ONG, Piotr KoniuszICML 2026 · 2 citations
- Efficient Credal Prediction through DecalibrationPaul Hofman, Timo Löhr, Maximilian Muschalik, Yusuf Sale et al.ICLR 2026 · 1 citation
Builds on9
- Laplace Redux - Effortless Bayesian Deep LearningErik A. Daxberger, Agustinus Kristiadi, Alexander Immer, Runa Eschenhagen et al.NeurIPS 2021 · 508 citations
- Human Uncertainty Makes Classification More RobustJoshua C. Peterson, Ruairidh M. Battleday, Thomas L. Griffiths, Olga RussakovskyICCV 2019 · 362 citations
- Hyperparameter Ensembles for Robustness and Uncertainty QuantificationFlorian Wenzel, Jasper Snoek, Dustin Tran, Rodolphe JenattonNeurIPS 2020 · 263 citations
- Repulsive Deep Ensembles are BayesianFrancesco D'Angelo, Vincent FortuinNeurIPS 2021 · 141 citations
- What Can We Learn from Collective Human Opinions on Natural Language Inference Data?Yixin Nie, Xiang Zhou, Mohit BansalEMNLP 2020 · 77 citations
Related papers
- Conformalized Credal Set PredictorsAlireza Javanmardi, David Stutz, Eyke HüllermeierNeurIPS 2024 · 28 citations
- Credal Deep Ensembles for Uncertainty QuantificationKaizheng Wang, Fabio Cuzzolin, Shireen Kudukkil Manchingal, Keivan Shariatmadar et al.NeurIPS 2024 · 37 citations
- Credal Ensemble Distillation for Uncertainty QuantificationKaizheng Wang, Fabio Cuzzolin, David Moens, Hans HallezAAAI 2026
- Credal Wrapper of Model Averaging for Uncertainty Estimation in ClassificationKaizheng Wang, Fabio Cuzzolin, Keivan Shariatmadar, David Moens et al.ICLR 2025
- Credal Concept Bottleneck Models for Epistemic-Aleatoric Uncertainty DecompositionTanmoy Mukherjee, Thomas Bailleux, Pierre Marquis, Zied BouraouiACL 2026
