A Memory-Efficient Hierarchical Algorithm for Large-scale Optimal Transport Problems
Wenzhou Xia, Ya-Nan Zhu, Jingwei Liang, Xiaoqun Zhang
Abstract
We propose HALO, a memory-efficient hierarchical algorithm for solving large-scale optimal transport (OT) problems with squared Euclidean cost, particularly effective in moderate-dimensional settings. The core of lies in combining a hierarchical representation of the OT problem with parallel-friendly linear programming solvers, within which an active pruning technique is integrated to further reduce memory usage and computational cost. Theoretically, we establish a scale-independent iteration-complexity upper bound for the refinement phase, which is consistent with our numerical observations. Numerically, experiments on the image dataset and the 3D point cloud dataset demonstrate that effectively alleviates the memory and scalability bottlenecks of existing solvers. Our method demonstrates significant advantages compared to state-of-the-art baselines: for images with pixels, it achieves an speedup and % reduction in memory usage under comparable accuracy; for 3D point clouds at scale , it achieves a speedup and an % reduction in memory usage with % lower transport cost.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Practical Large-Scale Linear Programming using Primal-Dual Hybrid GradientDavid L. Applegate, Mateo Díaz, Oliver Hinder, Haihao Lu et al.NeurIPS 2021 · 165 citations
- Optimal Flow Matching: Learning Straight Trajectories in Just One StepNikita Kornilov, Petr Mokrov, Alexander V. Gasnikov, Alexander KorotinNeurIPS 2024 · 93 citations
- Low-Rank Sinkhorn FactorizationMeyer Scetbon, Marco Cuturi, Gabriel PeyréICML 2021 · 76 citations
- Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random ProjectionsKimia Nadjahi, Alain Durmus, Pierre E. Jacob, Roland Badeau et al.NeurIPS 2021 · 54 citations
- A fast and accurate splitting method for optimal transport: analysis and implementationVien V. Mai, Jacob Lindbäck, Mikael JohanssonICLR 2022 · 15 citations
Related papers
- Hierarchical Refinement: Optimal Transport to Infinity and BeyondPeter Halmos, Julian Gold, Xinhao Liu, Benjamin J. RaphaelICML 2025
- Transport Clustering: Solving Low-Rank Optimal Transport via ClusteringHenri Schmidt, Peter Halmos, Benjamin RaphaelICML 2026
- Progressive Entropic Optimal Transport SolversParnian Kassraie, Aram-Alexandre Pooladian, Michal Klein, James Thornton et al.NeurIPS 2024 · 14 citations
- FlashSinkhorn: IO-Aware Entropic Optimal Transport on GPUFelix X.-F. Ye, Xingjie Li, An Yu, Ming-Ching Chang et al.ICML 2026 · 3 citations
- Optimal Transport with Symmetry GroupsJiechao Zhang, Huichun Zhang, Jian Sun, Wei ZengICML 2026
