The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?
Jean Barbier, TianQi Hou, Marco Mondelli, Manuel Sáenz
摘要
We consider the problem of estimating a rank-1 signal corrupted by structured rotationally invariant noise, and address the following question: how well do inference algorithms perform when the noise statistics is unknown and hence Gaussian noise is assumed? While the matched Bayes-optimal setting with unstructured noise is well understood, the analysis of this mismatched problem is only at its premises. In this paper, we make a step towards understanding the effect of the strong source of mismatch which is the noise statistics. Our main technical contribution is the rigorous analysis of a Bayes estimator and of an approximate message passing (AMP) algorithm, both of which incorrectly assume a Gaussian setup. The first result exploits the theory of spherical integrals and of low-rank matrix perturbations; the idea behind the second one is to design and analyze an artificial AMP which, by taking advantage of the flexibility in the denoisers, is able to "correct" the mismatch. Armed with these sharp asymptotic characterizations, we unveil a rich and often unexpected phenomenology. For example, despite AMP is in principle designed to efficiently compute the Bayes estimator, the former is outperformed by the latter in terms of mean-square error. We show that this performance gap is due to an incorrect estimation of the signal norm. In fact, when the SNR is large enough, the overlaps of the AMP and the Bayes estimator coincide, and they even match those of optimal estimators taking into account the structure of the noise. * Equal contribution.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Matrix Denoising with Doubly Heteroscedastic Noise: Fundamental Limits and Optimal Spectral MethodsYihan Zhang, Marco MondelliNeurIPS 2024 · 被引用 9 次
- Unrolled denoising networks provably learn to perform optimal Bayesian inferenceAayush Karan, Kulin Shah, Sitan Chen, Yonina C. EldarNeurIPS 2024 · 被引用 5 次
- Computational and Statistical Lower Bounds for Low-Rank Estimation under General Inhomogeneous NoiseDebsurya De, Dmitriy KuniskySTOC 2026 · 被引用 2 次
它引用的顶会 Paper5
- Phase retrieval in high dimensions: Statistical and computational phase transitionsAntoine Maillard, Bruno Loureiro, Florent Krzakala, Lenka ZdeborováNeurIPS 2020 · 被引用 73 次
- All-or-nothing statistical and computational phase transitions in sparse spiked matrix estimationJean Barbier, Nicolas Macris, Cynthia RushNeurIPS 2020 · 被引用 42 次
- Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message PassingRamji Venkataramanan, Kevin Kögler, Marco MondelliICML 2022 · 被引用 36 次
- PCA Initialization for Approximate Message Passing in Rotationally Invariant ModelsMarco Mondelli, Ramji VenkataramananNeurIPS 2021 · 被引用 23 次
- Analysis of Sensing Spectral for Signal Recovery under a Generalized Linear ModelJunjie Ma, Ji Xu, Arian MalekiNeurIPS 2021 · 被引用 10 次
相关 Paper
- Optimal Algorithms for the Inhomogeneous Spiked Wigner ModelAleksandr Pak, Justin Ko, Florent KrzakalaNeurIPS 2023 · 被引用 17 次
- Bayes-optimal learning of an extensive-width neural network from quadratically many samplesAntoine Maillard, Emanuele Troiani, Simon Martin, Florent Krzakala 等NeurIPS 2024 · 被引用 26 次
- Bayesian Extensive-Rank Matrix Factorization with Rotational Invariant PriorsFarzad Pourkamali, Nicolas MacrisNeurIPS 2023 · 被引用 10 次
- Markov Chains Approximate Message PassingAmit Rajaraman, David X. WuSTOC 2026
- Subspace clustering in high-dimensions: Phase transitions & Statistical-to-Computational gapLuca Pesce, Bruno Loureiro, Florent Krzakala, Lenka ZdeborováNeurIPS 2022 · 被引用 4 次
