One Step Closer to Unbiased Aleatoric Uncertainty Estimation
Wang Zhang, Ziwen Martin Ma, Subhro Das, Tsui-Wei Lily Weng, Alexandre Megretski, Luca Daniel, Lam M. Nguyen
Abstract
Neural networks are powerful tools in various applications, and quantifying their uncertainty is crucial for reliable decision-making. In the deep learning field, the uncertainties are usually categorized into aleatoric (data) and epistemic (model) uncertainty. In this paper, we point out that the existing popular variance attenuation method highly overestimates aleatoric uncertainty. To address this issue, we propose a new estimation method by actively de-noising the observed data 1 . By conducting a broad range of experiments, we demonstrate that our proposed approach provides a much closer approximation to the actual data uncertainty than the standard method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Adaptive Sampling to Reduce Epistemic Uncertainty Using Prediction Interval-Generation Neural NetworksGiorgio Morales, John W. SheppardAAAI 2025 · 3 citations
- Delving Aleatoric Uncertainty in Medical Image Segmentation via Vision Foundation ModelsRuiyang Li, Fang Liu, Licheng Jiao, Xinglin Xie et al.CVPR 2026 · 1 citation
- CUPID: A Plug-in Framework for Joint Aleatoric and Epistemic Uncertainty Estimation with a Single ModelXinran Xu, Xiuyi FanICLR 2026
Builds on4
- Deep Evidential RegressionAlexander Amini, Wilko Schwarting, Ava Soleimany, Daniela RusNeurIPS 2020 · 777 citations
- Active Learning for Deep Object Detection via Probabilistic ModelingJiwoong Choi, Ismail Elezi, Hyuk-Jae Lee, Clément Farabet et al.ICCV 2021 · 144 citations
- On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural NetworksMaximilian Seitzer, Arash Tavakoli, Dimitrije Antic, Georg MartiusICLR 2022 · 122 citations
- A Quantitative Geometric Approach to Neural-Network SmoothnessZi Wang, Gautam Prakriya, Somesh JhaNeurIPS 2022 · 20 citations
Related papers
- Cooperative Variance Estimation and Bayesian Neural Networks for Disentangling Aleatoric and Epistemic UncertaintiesJiaxiang Yi, Miguel BessaICML 2026 · 2 citations
- Uncertainty-Aware Deep Classifiers Using Generative ModelsMurat Sensoy, Lance M. Kaplan, Federico Cerutti, Maryam SalekiAAAI 2020 · 88 citations
- The Unreasonable Effectiveness of Deep Evidential RegressionNis Meinert, Jakob Gawlikowski, Alexander LavinAAAI 2023 · 58 citations
- General Uncertainty Estimation with Delta VariancesSimon Schmitt, John Shawe-Taylor, Hado van HasseltAAAI 2025 · 3 citations
- Sampling-Free Epistemic Uncertainty Estimation Using Approximated Variance PropagationJanis Postels, Francesco Ferroni, Huseyin Coskun, Nassir Navab et al.ICCV 2019 · 153 citations
