On the Convergence of Projected Bures-Wasserstein Gradient Descent under Euclidean Strong Convexity
Junyi Fan, Yuxuan Han, Zijian Liu, Jian-Feng Cai, Yang Wang, Zhengyuan Zhou
摘要
The Bures-Wasserstein (BW) gradient descent method has gained considerable attention in various domains, including Gaussian barycenter, matrix recovery and variational inference problems, due to its alignment with the Wasserstein geometry of normal distributions. Despite its popularity, existing convergence analysis are often contingent upon specific loss functions, and the exploration of constrained settings within this framework remains limited. In this work, we make an attempt to bridge this gap by providing a general convergence rate guarantee for BW gradient descent when the Euclidean strong convexity of the loss and the constraints is assumed. In an effort to advance practical implementations, we also derive a closed-form solution for the projection onto BW distance-constrained sets, which enables the fast implementation of projected BW gradient descent for problems that arise in the constrained barycenter and distributionally robust optimization literature. Experimental results demonstrate significant improvements in computational efficiency and convergence speed, underscoring the efficacy of our method in practical scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper6
- Variational inference via Wasserstein gradient flowsMarc Lambert, Sinho Chewi, Francis R. Bach, Silvère Bonnabel 等NeurIPS 2022 · 被引用 123 次
- Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descentJason M. Altschuler, Sinho Chewi, Patrik Gerber, Austin J. StrommeNeurIPS 2021 · 被引用 60 次
- On Riemannian Optimization over Positive Definite Matrices with the Bures-Wasserstein GeometryAndi Han, Bamdev Mishra, Pratik Kumar Jawanpuria, Junbin GaoNeurIPS 2021 · 被引用 55 次
- Distributionally Robust Linear Quadratic ControlBahar Taskesen, Dan A. Iancu, Çagil Koçyigit, Daniel KuhnNeurIPS 2023 · 被引用 49 次
- Forward-Backward Gaussian Variational Inference via JKO in the Bures-Wasserstein SpaceMichael Ziyang Diao, Krishna Balasubramanian, Sinho Chewi, Adil SalimICML 2023 · 被引用 47 次
相关 Paper
- Critical Points and Convergence Analysis of Generative Deep Linear Networks Trained with Bures-Wasserstein LossPierre Bréchet, Katerina Papagiannouli, Jing An, Guido MontúfarICML 2023 · 被引用 7 次
- Sobolev Gradient Ascent for Optimal Transport: Barycenter Optimization and Convergence AnalysisKaheon Kim, Bohan Zhou, Changbo Zhu, Xiaohui ChenICLR 2026 · 被引用 6 次
- Stochastic variance-reduced Gaussian variational inference on the Bures-Wasserstein manifoldHoang Phuc Hau Luu, Hanlin Yu, Bernardo Williams, Marcelo Hartmann 等ICLR 2025
- Complexity of Block Coordinate Descent with Proximal Regularization and Applications to Wasserstein CP-dictionary LearningDohyun Kwon, Hanbaek LyuICML 2023 · 被引用 3 次
- A Riemannian Exponential Augmented Lagrangian Method for Computing the Projection Robust Wasserstein DistanceBo Jiang, Ya-Feng LiuNeurIPS 2023 · 被引用 7 次
