Tree-sliced Sobolev IPM
Viet-Hoang Tran, Thanh Q. Tran, Thanh T. Chu, Duy-Tung Pham, Trung-Khang Tran, Tam Le, Tan M. Nguyen
摘要
Recent work shows Tree-Sliced Optimal Transport to be an efficient and more expressive alternative to Sliced Wasserstein (SW), improving downstream performance. Tree-sliced metrics compare probability distributions by projecting measures onto tree metric spaces; a central example is the Tree-Sliced Wasserstein (TSW) distance, which applies the -Wasserstein metric after projection. However, computing tree-based -Wasserstein for general is costly, largely confining practical use to . This restriction is a significant bottleneck, as higher-order metrics () are preferred in gradient-based learning for their more favorable optimization landscapes. In this work, we revisit Sobolev integral probability metrics (IPM) on trees to obtain a practical generalization of TSW. Building on the insight that a suitably regularized Sobolev IPM admits a closed-form expression, we introduce TS-Sobolev, a tree-sliced metric that aggregates regularized Sobolev IPMs over random tree systems and remains tractable for all ; for , TS-Sobolev has the same computational complexity as TSW at . Notably, at it recovers TSW exactly. Consequently, TS-Sobolev serves as a drop-in replacement for TSW in practical applications, with an additional flexibility in changing . Furthermore, we extend this framework to define a corresponding metric for probability measures on hyperspheres. Experiments on Euclidean and spherical datasets show that TS-Sobolev and its spherical variant improve downstream performance in gradient flows, self-supervised learning, generative modeling, and text topic modeling over recent SW and TSW variants. Our code is available at https://github.com/thanhquangtran/TS-Sobolev.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Quasi-Equivariant MetanetworksViet-Hoang Tran, An Nguyen The, Benoît Guérand, Thieu Vo 等ICLR 2026 · 被引用 1 次
- Revisiting Tree-Sliced Wasserstein Distance Through the Lens of the Fermat-Weber ProblemViet-Hoang Tran, Thanh Q. Tran, Thanh T. Chu, Trung-Khang Tran 等ICLR 2026
- Mixed-Curvature Tree-Sliced Wasserstein DistanceDuy-Tung Pham, Viet-Hoang Tran, Thieu Vo, Tan NguyenICLR 2026
它引用的顶会 Paper37
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 被引用 1,432 次
- Statistical and Topological Properties of Sliced Probability DivergencesKimia Nadjahi, Alain Durmus, Lénaïc Chizat, Soheil Kolouri 等NeurIPS 2020 · 被引用 115 次
- Distributional Sliced-Wasserstein and Applications to Generative ModelingKhai Nguyen, Nhat Ho, Tung Pham, Hung BuiICLR 2021 · 被引用 111 次
- Sliced Mutual Information: A Scalable Measure of Statistical DependenceZiv Goldfeld, Kristjan H. GreenewaldNeurIPS 2021 · 被引用 48 次
相关 Paper
- Tree-Sliced Wasserstein Distance with Nonlinear ProjectionThanh Tran, Hoang V. Tran, Thanh T. Chu, Huyen Trang Pham 等ICML 2025
- Spherical Tree-Sliced Wasserstein DistanceHoang V. Tran, Thanh T. Chu, Minh-Khoi Nguyen-Nhat, Huyen Trang Pham 等ICLR 2025
- Tree-Sliced Wasserstein Distance: A Geometric PerspectiveHoang V. Tran, Huyen Trang Pham, Tho Tran Huu, Minh-Khoi Nguyen-Nhat 等ICML 2025
- Distance-Based Tree-Sliced Wasserstein DistanceHoang V. Tran, Minh-Khoi Nguyen-Nhat, Huyen Trang Pham, Thanh T. Chu 等ICLR 2025 · 被引用 8 次
- Tree-Sliced Entropy Partial TransportViet-Hoang Tran, Thanh Tran, Thanh T. Chu, Tam Le 等NeurIPS 2025 · 被引用 3 次
