A Continuous-Time Mirror Descent Approach to Sparse Phase Retrieval
Fan Wu, Patrick Rebeschini
摘要
We analyze continuous-time mirror descent applied to sparse phase retrieval, which is the problem of recovering sparse signals from a set of magnitude-only measurements. We apply mirror descent to the unconstrained empirical risk minimization problem (batch setting), using the square loss and square measurements. We provide a convergence analysis of the algorithm in this non-convex setting and prove that, with the hypentropy mirror map, mirror descent recovers any -sparse vector with minimum (in modulus) non-zero entry on the order of from Gaussian measurements, modulo logarithmic terms. This yields a simple algorithm which, unlike most existing approaches to sparse phase retrieval, adapts to the sparsity level, without including thresholding steps or adding regularization terms. Our results also provide a principled theoretical understanding for Hadamard Wirtinger flow [58], as Euclidean gradient descent applied to the empirical risk problem with Hadamard parametrization can be recovered as a first-order approximation to mirror descent in discrete time.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of StochasticityScott Pesme, Loucas Pillaud-Vivien, Nicolas FlammarionNeurIPS 2021 · 被引用 135 次
- (S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of StabilityMathieu Even, Scott Pesme, Suriya Gunasekar, Nicolas FlammarionNeurIPS 2023 · 被引用 42 次
- Implicit Regularization in Matrix Sensing via Mirror DescentFan Wu, Patrick RebeschiniNeurIPS 2021 · 被引用 13 次
它引用的顶会 Paper1
相关 Paper
- A Fast and Provable Algorithm for Sparse Phase RetrievalJian-Feng Cai, Yu Long, Ruixue Wen, Jiaxi YingICLR 2024 · 被引用 5 次
- Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative PriorsZhaoqiang Liu, Subhroshekhar Ghosh, Jonathan ScarlettNeurIPS 2021 · 被引用 22 次
- Implicit Gradient RegularizationDavid G. T. Barrett, Benoit DherinICLR 2021 · 被引用 235 次
- Uniform Convergence with Square-Root Lipschitz LossLijia Zhou, Zhen Dai, Frederic Koehler, Nati SrebroNeurIPS 2023 · 被引用 2 次
- Implicit Bias of Mirror Flow on Separable DataScott Pesme, Radu-Alexandru Dragomir, Nicolas FlammarionNeurIPS 2024 · 被引用 7 次
