Statistical and Computational Guarantees of Kernel Max-Sliced Wasserstein Distances
Jie Wang, March Boedihardjo, Yao Xie
Abstract
Optimal transport has been very successful for various machine learning tasks; however, it is known to suffer from the curse of dimensionality. Hence, dimensionality reduction is desirable when applied to high-dimensional data with low-dimensional structures. The kernel maxsliced (KMS) Wasserstein distance is developed for this purpose by finding an optimal nonlinear mapping that reduces data into 1 dimension before computing the Wasserstein distance. However, its theoretical properties have not yet been fully developed. In this paper, we provide sharp finite-sample guarantees under milder technical assumptions compared with state-of-the-art for the KMS p-Wasserstein distance between two empirical distributions with n samples for general p ∈ [1, ∞). Algorithm-wise, we show that computing the KMS 2-Wasserstein distance is NP-hard, and then we further propose a semidefinite relaxation (SDR) formulation (which can be solved efficiently in polynomial time) and provide a relaxation gap for the obtained solution. We provide numerical examples to demonstrate the good performance of our scheme for high-dimensional two-sample testing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d220ae83-df22-4427-8cc0-2336ff9c39f4Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Learning Deep Kernels for Non-Parametric Two-Sample TestsFeng Liu, Wenkai Xu, Jie Lu, Guangquan Zhang et al.ICML 2020 · 213 citations
- Projection Robust Wasserstein Distance and Riemannian OptimizationTianyi Lin, Chenyou Fan, Nhat Ho, Marco Cuturi et al.NeurIPS 2020 · 84 citations
- Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein DistancesSloan Nietert, Ziv Goldfeld, Ritwik Sadhu, Kengo KatoNeurIPS 2022 · 73 citations
- Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta LearningYifan Hu, Siqi Zhang, Xin Chen, Niao HeNeurIPS 2020 · 69 citations
- Energy-Based Sliced Wasserstein DistanceKhai Nguyen, Nhat HoNeurIPS 2023 · 51 citations
Related papers
- Smooth p-Wasserstein Distance: Structure, Empirical Approximation, and Statistical ApplicationsSloan Nietert, Ziv Goldfeld, Kengo KatoICML 2021 · 39 citations
- A Swiss Army Knife for Minimax Optimal TransportSofien Dhouib, Ievgen Redko, Tanguy Kerdoncuff, Rémi Emonet et al.ICML 2020 · 21 citations
- Distributional Convergence of the Sliced Wasserstein ProcessJiaqi Xi, Jonathan Niles-WeedNeurIPS 2022 · 12 citations
- Semidefinite Relaxations of the Gromov-Wasserstein DistanceJunyu Chen, Binh T. Nguyen, Shang Koh, Yong Sheng SohNeurIPS 2024 · 18 citations
- A Riemannian Block Coordinate Descent Method for Computing the Projection Robust Wasserstein DistanceMinhui Huang, Shiqian Ma, Lifeng LaiICML 2021 · 45 citations
