Mirror Sinkhorn: Fast Online Optimization on Transport Polytopes
Marin Ballu, Quentin Berthet
2023Year
9Citations
3Top-tier citations
Abstract
Optimal transport is an important tool in machine learning, allowing to capture geometric properties of the data through a linear program on transport polytopes. We present a single-loop optimization algorithm for minimizing general convex objectives on these domains, utilizing the principles of Sinkhorn matrix scaling and mirror descent. The proposed algorithm is robust to noise, and can be used in an online setting. We provide theoretical guarantees for convex objectives and experimental results showcasing it effectiveness on both synthetic and real-world data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Bisimulation Metrics are Optimal Transport Distances, and Can be Computed EfficientlySergio Calo, Anders Jonsson, Gergely Neu, Ludovic Schwartz et al.NeurIPS 2024 · 9 citations
- Optimal Transport with Tempered Exponential MeasuresEhsan Amid, Frank Nielsen, Richard Nock, Manfred K. WarmuthAAAI 2024 · 4 citations
- A Truncated Newton Method for Optimal TransportMete Kemertas, Amir-massoud Farahmand, Allan Douglas JepsonICLR 2025
Builds on12
- Differentiation of Blackbox Combinatorial SolversMarin Vlastelica Pogancic, Anselm Paulus, Vít Musil, Georg Martius et al.ICLR 2020 · 341 citations
- Fast Differentiable Sorting and RankingMathieu Blondel, Olivier Teboul, Quentin Berthet, Josip DjolongaICML 2020 · 285 citations
- Learning with Differentiable Pertubed OptimizersQuentin Berthet, Mathieu Blondel, Olivier Teboul, Marco Cuturi et al.NeurIPS 2020 · 181 citations
- Gradient Estimation with Stochastic Softmax TricksMax B. Paulus, Dami Choi, Daniel Tarlow, Andreas Krause et al.NeurIPS 2020 · 104 citations
- Mirror Descent with Relative Smoothness in Measure Spaces, with application to Sinkhorn and EMPierre-Cyril Aubin-Frankowski, Anna Korba, Flavien LégerNeurIPS 2022 · 61 citations
Related papers
- Online Sinkhorn: Optimal Transport distances from sample streamsArthur Mensch, Gabriel PeyréNeurIPS 2020 · 35 citations
- Regularized Optimal Transport is Ground Cost AdversarialFrançois-Pierre Paty, Marco CuturiICML 2020 · 33 citations
- Outlier-Robust Optimal TransportDebarghya Mukherjee, Aritra Guha, Justin M. Solomon, Yuekai Sun et al.ICML 2021 · 57 citations
- Stochastic Optimization for Regularized Wasserstein EstimatorsMarin Ballu, Quentin Berthet, Francis R. BachICML 2020 · 17 citations
- A Swiss Army Knife for Minimax Optimal TransportSofien Dhouib, Ievgen Redko, Tanguy Kerdoncuff, Rémi Emonet et al.ICML 2020 · 21 citations
