New streaming algorithms for high dimensional EMD and MST
Xi Chen, Rajesh Jayaram, Amit Levi, Erik Waingarten
Abstract
We study streaming algorithms for two fundamental geometric problems: computing the cost of a Minimum Spanning Tree (MST) of an n-point set X ⊂ 1, 2, . . . , ∆ d , and computing the Earth Mover Distance (EMD) between two multi-sets A, B ⊂ 1, 2, . . . , ∆ d of size n. We consider the turnstile model, where points can be added and removed. We give a one-pass streaming algorithm for MST and a two-pass streaming algorithm for EMD, both achieving an approximation factor of Õ(log n) and using polylog(n, d, ∆)-space only. Furthermore, our algorithm for EMD can be compressed to a single pass with a small additive error. Previously, the best known sublinear-space streaming algorithms for either problem achieved an approximation of O(minlog n, log(∆d) log n) [AIK08, BDI + 20]. For MST, we also prove that any constant space streaming algorithm can only achieve an approximation of Ω(log n), analogous to the Ω(log n) lower bound for EMD of [AIK08].
Our algorithms are based on an improved analysis of a recursive space partitioning method known generically as the Quadtree. Specifically, we show that the Quadtree achieves an Õ(log n) approximation for both EMD and MST, improving on the O(minlog n, log(∆d) log n) approximation of [AIK08, BDI + 20].
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 816538c2-6c2d-4677-941b-05e54a6a3277Cited by top-tier papers23
- MUVERA: Multi-Vector Retrieval via Fixed Dimensional EncodingLaxman Dhulipala, Majid Hadian, Rajesh Jayaram, Jason Lee et al.NeurIPS 2024 · 56 citations
- Streaming Facility Location in High Dimension via Geometric HashingArtur Czumaj, Shaofeng H.-C. Jiang, Robert Krauthgamer, Pavel Veselý et al.FOCS 2022 · 11 citations
- Adversarially Robust Dense-Sparse Tradeoffs via Heavy-HittersDavid P. Woodruff, Samson ZhouNeurIPS 2024 · 9 citations
- Unleashing Graph Partitioning for Large-Scale Nearest Neighbor SearchLars Gottesbüren, Laxman Dhulipala, Rajesh Jayaram, Jakub LackiVLDB 2025 · 6 citations
- Streaming Euclidean MST to a Constant FactorXi Chen, Vincent Cohen-Addad, Rajesh Jayaram, Amit Levi et al.STOC 2023 · 5 citations
Builds on1
Related papers
- Approximate Earth Mover's Distance in Truly-Subquadratic TimeLorenzo Beretta, Aviad RubinsteinSTOC 2024 · 3 citations
- A Polynomial Space Lower Bound for Diameter Estimation in Dynamic StreamsSanjeev Khanna, Ashwin Padaki, Krish Singal, Erik WaingartenFOCS 2025 · 3 citations
- Streaming Euclidean Max-Cut: Dimension vs Data ReductionXiaoyu Chen, Shaofeng H.-C. Jiang, Robert KrauthgamerSTOC 2023 · 4 citations
- Approximating High-Dimensional Earth Mover's Distance as Fast as Closest PairLorenzo Beretta, Vincent Cohen-Addad, Rajesh Jayaram, Erik WaingartenFOCS 2025 · 2 citations
- Semi-Streaming Bipartite Matching in Fewer Passes and Optimal SpaceSepehr Assadi, Arun Jambulapati, Yujia Jin, Aaron Sidford et al.SODA 2022 · 9 citations
