Guarantees of a Preconditioned Subgradient Algorithm for Overparameterized Asymmetric Low-rank Matrix Recovery
Paris Giampouras, HanQin Cai, René Vidal
摘要
In this paper, we focus on a matrix factorizationbased approach to recover low-rank asymmetric matrices from corrupted measurements. We propose an Overparameterized Preconditioned Subgradient Algorithm (OPSA) and provide, for the first time in the literature, linear convergence rates independent of the rank of the sought asymmetric matrix in the presence of gross corruptions. Our work goes beyond existing results in preconditioned-type approaches addressing their current limitation, i.e., the lack of convergence guarantees in the case of asymmetric matrices of unknown rank. By applying our approach to (robust) matrix sensing, we highlight its merits when the measurement operator satisfies a mixednorm restricted isometry property. Lastly, we present extensive numerical experiments that validate our theoretical results and demonstrate the effectiveness of our approach for different levels of overparameterization and outlier corruptions.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- The Power of Preconditioning in Overparameterized Low-Rank Matrix SensingXingyu Xu, Yandi Shen, Yuejie Chi, Cong MaICML 2023 · 被引用 51 次
- LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and EfficientlyYuanhe Zhang, Fanghui Liu, Yudong ChenICML 2025
它引用的顶会 Paper8
- Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstructionDominik Stöger, Mahdi SoltanolkotabiNeurIPS 2021 · 被引用 101 次
- Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier DetectionHanQin Cai, Jialin Liu, Wotao YinNeurIPS 2021 · 被引用 69 次
- The Power of Preconditioning in Overparameterized Low-Rank Matrix SensingXingyu Xu, Yandi Shen, Yuejie Chi, Cong MaICML 2023 · 被引用 51 次
- Riemannian Preconditioned LoRA for Fine-Tuning Foundation ModelsFangzhao Zhang, Mert PilanciICML 2024 · 被引用 43 次
- Rank Overspecified Robust Matrix Recovery: Subgradient Method and Exact RecoveryLijun Ding, Liwei Jiang, Yudong Chen, Qing Qu 等NeurIPS 2021 · 被引用 30 次
相关 Paper
- How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and InitializationNuoya Xiong, Lijun Ding, Simon Shaolei DuICLR 2024 · 被引用 22 次
- Global Convergence of Gradient Descent for Asymmetric Low-Rank Matrix FactorizationTian Ye, Simon S. DuNeurIPS 2021 · 被引用 61 次
- Local and Global Linear Convergence of General Low-Rank Matrix Recovery ProblemsYingjie Bi, Haixiang Zhang, Javad LavaeiAAAI 2022 · 被引用 21 次
- Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix FactorizationJialun Zhang, Salar Fattahi, Richard Y. ZhangNeurIPS 2021 · 被引用 47 次
- RGNMR: A Gauss-Newton method for robust matrix completion with theoretical guaranteesEilon Vaknin Laufer, Boaz NadlerNeurIPS 2025 · 被引用 1 次
