Robust covariance estimation with missing values and cell-wise contamination
Grégoire Pacreau, Karim Lounici
Abstract
Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix. Moreover, the robust procedures designed to address this problem require the invertibility of the covariance operator and thus are not effective on high-dimensional data. In this paper, we propose an unbiased estimator for the covariance in the presence of missing values that does not require any imputation step and still achieves near minimax statistical accuracy with the operator norm. We also advocate for its use in combination with cell-wise outlier detection methods to tackle cell-wise contamination in a high-dimensional and low-rank setting, where state-of-the-art methods may suffer from numerical instability and long computation times. To complement our theoretical findings, we conducted an experimental study which demonstrates the superiority of our approach over the state of the art both in low and high dimension settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on2
- HyperImpute: Generalized Iterative Imputation with Automatic Model SelectionDaniel Jarrett, Bogdan Cebere, Tennison Liu, Alicia Curth et al.ICML 2022 · 129 citations
- VAEM: a Deep Generative Model for Heterogeneous Mixed Type DataChao Ma, Sebastian Tschiatschek, Richard E. Turner, José Miguel Hernández-Lobato et al.NeurIPS 2020 · 105 citations
Related papers
- Outlier Robust Mean Estimation with Subgaussian Rates via StabilityIlias Diakonikolas, Daniel M. Kane, Ankit PensiaNeurIPS 2020 · 76 citations
- Robust Gaussian Covariance Estimation in Nearly-Matrix Multiplication TimeJerry Li, Guanghao YeNeurIPS 2020 · 13 citations
- Robust Kernel Density Estimation with Median-of-Means principlePierre Humbert, Batiste Le Bars, Ludovic MinvielleICML 2022 · 19 citations
- Efficient Multivariate Robust Mean Estimation Under Mean-Shift ContaminationIlias Diakonikolas, Giannis Iakovidis, Daniel Kane, Thanasis PittasICML 2025
- A Subquadratic Time Algorithm for Robust Sparse Mean EstimationAnkit PensiaICML 2024 · 1 citation
