Improved Distribution Estimation in
Doron Cohen, Aryeh Kontorovich, Yonatan Livshitz
2026Year
Abstract
We present improved bounds for estimating discrete probability distributions under the norm. These include minimax bounds in expectation and high-probability tail bounds. We resolve some of the open questions posed in Kontorovich and Painsky (JMLR, 2025) --- including a fully empirical version of the tightest risk bound they presented and identifying the form of the worst-case extremal distribution. Encouraging empirical results are reported as well.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 218602d3-3d03-4c2a-a4d9-1af96fe19634Builds on1
Related papers
- Learning discrete distributions with infinite supportDoron Cohen, Aryeh Kontorovich, Geoffrey WolferNeurIPS 2020 · 21 citations
- Optimal Excess Risk Bounds for Empirical Risk Minimization on p-Norm Linear RegressionAyoub El Hanchi, Murat A. ErdogduNeurIPS 2023 · 2 citations
- Dimension-free empirical entropy estimationDoron Cohen, Aryeh Kontorovich, Aaron Koolyk, Geoffrey WolferNeurIPS 2021 · 6 citations
- Instance-Optimality for Private KL Distribution EstimationJiayuan Ye, Vitaly Feldman, Kunal TalwarNeurIPS 2025
- Tight Asymptotics of Extreme Order StatisticsJosé Correa, Frederik Mallmann-Trenn, Matías RomeroNeurIPS 2025
