On Unbalanced Optimal Transport: An Analysis of Sinkhorn Algorithm
Khiem Pham, Khang Le, Nhat Ho, Tung Pham, Hung Bui
Abstract
We provide a computational complexity analysis for the Sinkhorn algorithm that solves the entropic regularized Unbalanced Optimal Transport (UOT) problem between two measures of possibly different masses with at most components. We show that the complexity of the Sinkhorn algorithm for finding an -approximate solution to the UOT problem is of order , which is near-linear time. To the best of our knowledge, this complexity is better than the complexity of the Sinkhorn algorithm for solving the Optimal Transport (OT) problem, which is of order . Our proof technique is based on the geometric convergence of the Sinkhorn updates to the optimal dual solution of the entropic regularized UOT problem and some properties of the primal solution. It is also different from the proof for the complexity of the Sinkhorn algorithm for approximating the OT problem since the UOT solution does not have to meet the marginal constraints.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers35
- Unbalanced minibatch Optimal Transport; applications to Domain AdaptationKilian Fatras, Thibault Séjourné, Rémi Flamary, Nicolas CourtyICML 2021 · 183 citations
- The Unbalanced Gromov Wasserstein Distance: Conic Formulation and RelaxationThibault Séjourné, François-Xavier Vialard, Gabriel PeyréNeurIPS 2021 · 106 citations
- Learning to Count via Unbalanced Optimal TransportZhiheng Ma, Xing Wei, Xiaopeng Hong, Hui Lin et al.AAAI 2021 · 100 citations
- Optimal Transport for Treatment Effect EstimationHao Wang, Jiajun Fan, Zhichao Chen, Haoxuan Li et al.NeurIPS 2023 · 71 citations
- Improving Mini-batch Optimal Transport via Partial TransportationKhai Nguyen, Dang Nguyen, The-Anh Vu-Le, Tung Pham et al.ICML 2022 · 60 citations
Related papers
- Entropic Optimal Transport between Unbalanced Gaussian Measures has a Closed FormHicham Janati, Boris Muzellec, Gabriel Peyré, Marco CuturiNeurIPS 2020 · 109 citations
- A fast and accurate splitting method for optimal transport: analysis and implementationVien V. Mai, Jacob Lindbäck, Mikael JohanssonICLR 2022 · 15 citations
- Online Sinkhorn: Optimal Transport distances from sample streamsArthur Mensch, Gabriel PeyréNeurIPS 2020 · 35 citations
- Batch Greenkhorn Algorithm for Entropic-Regularized Multimarginal Optimal Transport: Linear Rate of Convergence and Iteration ComplexityVladimir R. Kostic, Saverio Salzo, Massimiliano PontilICML 2022 · 3 citations
- Accelerating Sinkhorn algorithm with sparse Newton iterationsXun Tang, Michael Shavlovsky, Holakou Rahmanian, Elisa Tardini et al.ICLR 2024 · 11 citations
