On the Convergence of Projected Bures-Wasserstein Gradient Descent under Euclidean Strong Convexity
Junyi Fan, Yuxuan Han, Zijian Liu, Jian-Feng Cai, Yang Wang, Zhengyuan Zhou
Abstract
The Bures-Wasserstein (BW) gradient descent method has gained considerable attention in various domains, including Gaussian barycenter, matrix recovery and variational inference problems, due to its alignment with the Wasserstein geometry of normal distributions. Despite its popularity, existing convergence analysis are often contingent upon specific loss functions, and the exploration of constrained settings within this framework remains limited. In this work, we make an attempt to bridge this gap by providing a general convergence rate guarantee for BW gradient descent when the Euclidean strong convexity of the loss and the constraints is assumed. In an effort to advance practical implementations, we also derive a closed-form solution for the projection onto BW distance-constrained sets, which enables the fast implementation of projected BW gradient descent for problems that arise in the constrained barycenter and distributionally robust optimization literature. Experimental results demonstrate significant improvements in computational efficiency and convergence speed, underscoring the efficacy of our method in practical scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6ee12cb7-31da-4c61-bbaf-c4da4b184056Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Variational inference via Wasserstein gradient flowsMarc Lambert, Sinho Chewi, Francis R. Bach, Silvère Bonnabel et al.NeurIPS 2022 · 123 citations
- Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descentJason M. Altschuler, Sinho Chewi, Patrik Gerber, Austin J. StrommeNeurIPS 2021 · 60 citations
- On Riemannian Optimization over Positive Definite Matrices with the Bures-Wasserstein GeometryAndi Han, Bamdev Mishra, Pratik Kumar Jawanpuria, Junbin GaoNeurIPS 2021 · 55 citations
- Distributionally Robust Linear Quadratic ControlBahar Taskesen, Dan A. Iancu, Çagil Koçyigit, Daniel KuhnNeurIPS 2023 · 49 citations
- Forward-Backward Gaussian Variational Inference via JKO in the Bures-Wasserstein SpaceMichael Ziyang Diao, Krishna Balasubramanian, Sinho Chewi, Adil SalimICML 2023 · 47 citations
Related papers
- Critical Points and Convergence Analysis of Generative Deep Linear Networks Trained with Bures-Wasserstein LossPierre Bréchet, Katerina Papagiannouli, Jing An, Guido MontúfarICML 2023 · 7 citations
- Sobolev Gradient Ascent for Optimal Transport: Barycenter Optimization and Convergence AnalysisKaheon Kim, Bohan Zhou, Changbo Zhu, Xiaohui ChenICLR 2026 · 6 citations
- Stochastic variance-reduced Gaussian variational inference on the Bures-Wasserstein manifoldHoang Phuc Hau Luu, Hanlin Yu, Bernardo Williams, Marcelo Hartmann et al.ICLR 2025
- Complexity of Block Coordinate Descent with Proximal Regularization and Applications to Wasserstein CP-dictionary LearningDohyun Kwon, Hanbaek LyuICML 2023 · 3 citations
- A Riemannian Exponential Augmented Lagrangian Method for Computing the Projection Robust Wasserstein DistanceBo Jiang, Ya-Feng LiuNeurIPS 2023 · 7 citations
