Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descent
Jason M. Altschuler, Sinho Chewi, Patrik Gerber, Austin J. Stromme
摘要
We study first-order optimization algorithms for computing the barycenter of Gaussian distributions with respect to the optimal transport metric. Although the objective is geodesically non-convex, Riemannian GD empirically converges rapidly, in fact faster than off-the-shelf methods such as Euclidean GD and SDP solvers. This stands in stark contrast to the best-known theoretical results for Riemannian GD, which depend exponentially on the dimension. In this work, we prove new geodesic convexity results which provide stronger control of the iterates, yielding a dimension-free convergence rate. Our techniques also enable the analysis of two related notions of averaging, the entropically-regularized barycenter and the geometric median, providing the first convergence guarantees for Riemannian GD for these problems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper14
- Forward-Backward Gaussian Variational Inference via JKO in the Bures-Wasserstein SpaceMichael Ziyang Diao, Krishna Balasubramanian, Sinho Chewi, Adil SalimICML 2023 · 被引用 47 次
- Wasserstein Iterative Networks for Barycenter EstimationAlexander Korotin, Vage Egiazarian, Lingxiao Li, Evgeny BurnaevNeurIPS 2022 · 被引用 34 次
- Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-OutJun-Kun Wang, Chi-Heng Lin, Andre Wibisono, Bin HuICML 2022 · 被引用 27 次
- Measure Estimation in the Barycentric Coding ModelMatthew Werenski, Ruijie Jiang, Abiy Tasissa, Shuchin Aeron 等ICML 2022 · 被引用 16 次
- Acceleration via silver step-size on Riemannian manifolds with applications to Wasserstein spaceJiyoung Park, Abhishek Roy, Jonathan W. Siegel, Anirban BhattacharyaNeurIPS 2025 · 被引用 3 次
它引用的顶会 Paper7
- Entropic Optimal Transport between Unbalanced Gaussian Measures has a Closed FormHicham Janati, Boris Muzellec, Gabriel Peyré, Marco CuturiNeurIPS 2020 · 被引用 109 次
- Efficient constrained sampling via the mirror-Langevin algorithmKwangjun Ahn, Sinho ChewiNeurIPS 2021 · 被引用 77 次
- Scalable Computations of Wasserstein Barycenter via Input Convex Neural NetworksYongxin Chen, Jiaojiao Fan, Amirhossein TaghvaeiICML 2021 · 被引用 66 次
- Continuous Regularized Wasserstein BarycentersLingxiao Li, Aude Genevay, Mikhail Yurochkin, Justin M. SolomonNeurIPS 2020 · 被引用 61 次
- Fixed-Support Wasserstein Barycenters: Computational Hardness and Fast AlgorithmTianyi Lin, Nhat Ho, Xi Chen, Marco Cuturi 等NeurIPS 2020 · 被引用 60 次
相关 Paper
- Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal PointDavid Martínez-Rubio, Christophe Roux, Sebastian PokuttaICML 2024 · 被引用 3 次
- Debiased Sinkhorn barycentersHicham Janati, Marco Cuturi, Alexandre GramfortICML 2020 · 被引用 62 次
- Accelerated Gradient Methods for Geodesically Convex Optimization: Tractable Algorithms and Convergence AnalysisJungbin Kim, Insoon YangICML 2022 · 被引用 26 次
- First-Order Algorithms for Min-Max Optimization in Geodesic Metric SpacesMichael I. Jordan, Tianyi Lin, Emmanouil V. Vlatakis-GkaragkounisNeurIPS 2022 · 被引用 25 次
- Entropic Gromov-Wasserstein between Gaussian DistributionsKhang Le, Dung Q. Le, Huy Nguyen, Dat Do 等ICML 2022 · 被引用 21 次
