Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descent
Jason M. Altschuler, Sinho Chewi, Patrik Gerber, Austin J. Stromme
Abstract
We study first-order optimization algorithms for computing the barycenter of Gaussian distributions with respect to the optimal transport metric. Although the objective is geodesically non-convex, Riemannian GD empirically converges rapidly, in fact faster than off-the-shelf methods such as Euclidean GD and SDP solvers. This stands in stark contrast to the best-known theoretical results for Riemannian GD, which depend exponentially on the dimension. In this work, we prove new geodesic convexity results which provide stronger control of the iterates, yielding a dimension-free convergence rate. Our techniques also enable the analysis of two related notions of averaging, the entropically-regularized barycenter and the geometric median, providing the first convergence guarantees for Riemannian GD for these problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 628ca70a-2e78-443f-8b6e-f693b8466ea5Cited by top-tier papers14
- Forward-Backward Gaussian Variational Inference via JKO in the Bures-Wasserstein SpaceMichael Ziyang Diao, Krishna Balasubramanian, Sinho Chewi, Adil SalimICML 2023 · 47 citations
- Wasserstein Iterative Networks for Barycenter EstimationAlexander Korotin, Vage Egiazarian, Lingxiao Li, Evgeny BurnaevNeurIPS 2022 · 34 citations
- Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-OutJun-Kun Wang, Chi-Heng Lin, Andre Wibisono, Bin HuICML 2022 · 27 citations
- Measure Estimation in the Barycentric Coding ModelMatthew Werenski, Ruijie Jiang, Abiy Tasissa, Shuchin Aeron et al.ICML 2022 · 16 citations
- Acceleration via silver step-size on Riemannian manifolds with applications to Wasserstein spaceJiyoung Park, Abhishek Roy, Jonathan W. Siegel, Anirban BhattacharyaNeurIPS 2025 · 3 citations
Builds on7
- Entropic Optimal Transport between Unbalanced Gaussian Measures has a Closed FormHicham Janati, Boris Muzellec, Gabriel Peyré, Marco CuturiNeurIPS 2020 · 109 citations
- Efficient constrained sampling via the mirror-Langevin algorithmKwangjun Ahn, Sinho ChewiNeurIPS 2021 · 77 citations
- Scalable Computations of Wasserstein Barycenter via Input Convex Neural NetworksYongxin Chen, Jiaojiao Fan, Amirhossein TaghvaeiICML 2021 · 66 citations
- Continuous Regularized Wasserstein BarycentersLingxiao Li, Aude Genevay, Mikhail Yurochkin, Justin M. SolomonNeurIPS 2020 · 61 citations
- Fixed-Support Wasserstein Barycenters: Computational Hardness and Fast AlgorithmTianyi Lin, Nhat Ho, Xi Chen, Marco Cuturi et al.NeurIPS 2020 · 60 citations
Related papers
- Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal PointDavid Martínez-Rubio, Christophe Roux, Sebastian PokuttaICML 2024 · 3 citations
- Debiased Sinkhorn barycentersHicham Janati, Marco Cuturi, Alexandre GramfortICML 2020 · 62 citations
- Accelerated Gradient Methods for Geodesically Convex Optimization: Tractable Algorithms and Convergence AnalysisJungbin Kim, Insoon YangICML 2022 · 26 citations
- First-Order Algorithms for Min-Max Optimization in Geodesic Metric SpacesMichael I. Jordan, Tianyi Lin, Emmanouil V. Vlatakis-GkaragkounisNeurIPS 2022 · 25 citations
- Entropic Gromov-Wasserstein between Gaussian DistributionsKhang Le, Dung Q. Le, Huy Nguyen, Dat Do et al.ICML 2022 · 21 citations
