Robust covariance estimation with missing values and cell-wise contamination
Grégoire Pacreau, Karim Lounici
摘要
Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix. Moreover, the robust procedures designed to address this problem require the invertibility of the covariance operator and thus are not effective on high-dimensional data. In this paper, we propose an unbiased estimator for the covariance in the presence of missing values that does not require any imputation step and still achieves near minimax statistical accuracy with the operator norm. We also advocate for its use in combination with cell-wise outlier detection methods to tackle cell-wise contamination in a high-dimensional and low-rank setting, where state-of-the-art methods may suffer from numerical instability and long computation times. To complement our theoretical findings, we conducted an experimental study which demonstrates the superiority of our approach over the state of the art both in low and high dimension settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper2
- HyperImpute: Generalized Iterative Imputation with Automatic Model SelectionDaniel Jarrett, Bogdan Cebere, Tennison Liu, Alicia Curth 等ICML 2022 · 被引用 129 次
- VAEM: a Deep Generative Model for Heterogeneous Mixed Type DataChao Ma, Sebastian Tschiatschek, Richard E. Turner, José Miguel Hernández-Lobato 等NeurIPS 2020 · 被引用 105 次
相关 Paper
- Outlier Robust Mean Estimation with Subgaussian Rates via StabilityIlias Diakonikolas, Daniel M. Kane, Ankit PensiaNeurIPS 2020 · 被引用 76 次
- Robust Gaussian Covariance Estimation in Nearly-Matrix Multiplication TimeJerry Li, Guanghao YeNeurIPS 2020 · 被引用 13 次
- Robust Kernel Density Estimation with Median-of-Means principlePierre Humbert, Batiste Le Bars, Ludovic MinvielleICML 2022 · 被引用 19 次
- Efficient Multivariate Robust Mean Estimation Under Mean-Shift ContaminationIlias Diakonikolas, Giannis Iakovidis, Daniel Kane, Thanasis PittasICML 2025
- A Subquadratic Time Algorithm for Robust Sparse Mean EstimationAnkit PensiaICML 2024 · 被引用 1 次
