Robust Density Estimation under Besov IPM Losses
Ananya Uppal, Shashank Singh, Barnabás Póczos
Abstract
We study minimax convergence rates of nonparametric density estimation under the Huber contamination model, in which a proportion of the data comes from an unknown outlier distribution. We provide the first results for this problem under a large family of losses, called Besov integral probability metrics (IPMs), that include the L p , Wasserstein, Kolmogorov-Smirnov, Cramer-von Mises, and other commonly used metrics. Under a range of smoothness assumptions on the population and outlier distributions, we show that a re-scaled thresholding wavelet estimator converges at minimax optimal rates under a wide variety of losses and also exhibits optimal dependence on the contamination proportion. We also provide a purely data-dependent extension of the estimator that adapts to both an unknown contamination proportion and the unknown smoothness of the true density. Finally, based on connections recently shown between density estimation under IPM losses and generative adversarial networks (GANs), we show that certain GAN architectures are robustly minimax optimal.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e813b482-51ca-4608-bafd-1784b9182fb8Cited by top-tier papers2
- Breaking the curse of dimensionality in structured density estimationRobert A. Vandermeulen, Wai Ming Tai, Bryon AragamNeurIPS 2024 · 5 citations
- Tree-sliced Sobolev IPMViet-Hoang Tran, Thanh Q. Tran, Thanh T. Chu, Duy-Tung Pham et al.ICLR 2026
Related papers
- Function-space regularized Rényi divergencesJeremiah Birrell, Yannis Pantazis, Paul Dupuis, Luc Rey-Bellet et al.ICLR 2023 · 1 citation
- Robust Estimation Under Heterogeneous Corruption RatesSyomantak Chaudhuri, Jerry Li, Thomas A. CourtadeNeurIPS 2025
- Robust Kernel Density Estimation with Median-of-Means principlePierre Humbert, Batiste Le Bars, Ludovic MinvielleICML 2022 · 19 citations
- Distributional Robustness with IPMs and links to Regularization and GANsHisham HusainNeurIPS 2020 · 25 citations
- Outlier Robust Mean Estimation with Subgaussian Rates via StabilityIlias Diakonikolas, Daniel M. Kane, Ankit PensiaNeurIPS 2020 · 76 citations
