Streaming Euclidean k-median and k-means with o(log n) Space
Vincent Cohen-Addad, David P. Woodruff, Samson Zhou
Abstract
We consider the classic Euclidean k-median and k-means objective on data streams, where the goal is to provide a -approximation to the optimal k-median or k-means solution, while using as little memory as possible. Over the last 20 years, clustering in data streams has received a tremendous amount of attention and has been the test-bed for a large variety of new techniques, including coresets, the merge-and-reduce framework, bicriteria approximation, sensitivity sampling, and so on. Despite this intense effort to obtain smaller sketches for these problems, all known techniques require storing at least words of memory, where n is size of the input and is the aspect ratio. A natural question is if one can beat this logarithmic dependence on n and . In this paper, we break this barrier by first giving an insertion-only streaming algorithm that achieves a -approximation to the more general -clustering problem, using words of memory. Our techniques can also be used to achieve two-pass algorithms for k-median and k-means clustering on dynamic streams using words of memory.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers10
- Near-Optimal k-Clustering in the Sliding Window ModelDavid P. Woodruff, Peilin Zhong, Samson ZhouNeurIPS 2023 · 14 citations
- Adversarially Robust Dense-Sparse Tradeoffs via Heavy-HittersDavid P. Woodruff, Samson ZhouNeurIPS 2024 · 9 citations
- Turnstile ℓp leverage score sampling with applicationsAlexander Munteanu, Simon OmlorICML 2024 · 4 citations
- Nearly Space-Optimal Graph and Hypergraph Sparsification in Insertion-Only Data StreamsVincent Cohen-Addad, David P. Woodruff, Shenghao Xie, Samson ZhouICLR 2026 · 2 citations
- Sensitivity Sampling for k-Means: Worst Case and Stability Optimal Coreset BoundsNikhil Bansal, Vincent Cohen-Addad, Milind Prabhu, David Saulpic et al.FOCS 2024 · 2 citations
Builds on10
- Coresets for clustering in Euclidean spaces: importance sampling is nearly optimalLingxiao Huang, Nisheeth K. VishnoiSTOC 2020 · 36 citations
- Dimensionality Reduction for Wasserstein BarycenterZachary Izzo, Sandeep Silwal, Samson ZhouNeurIPS 2021 · 25 citations
- Near Optimal Linear Algebra in the Online and Sliding Window ModelsVladimir Braverman, Petros Drineas, Cameron Musco, Christopher Musco et al.FOCS 2020 · 24 citations
- Towards optimal lower bounds for k-median and k-means coresetsVincent Cohen-Addad, Kasper Green Larsen, David Saulpic, Chris SchwiegelshohnSTOC 2022 · 20 citations
- Fast Regression for Structured InputsRaphael A. Meyer, Cameron Musco, Christopher Musco, David P. Woodruff et al.ICLR 2022 · 14 citations
Related papers
- Consistent k-Clustering for General MetricsHendrik Fichtenberger, Silvio Lattanzi, Ashkan Norouzi-Fard, Ola SvenssonSODA 2021 · 7 citations
- A new coreset framework for clusteringVincent Cohen-Addad, David Saulpic, Chris SchwiegelshohnSTOC 2021 · 3 citations
- Improved Coresets for Euclidean k-MeansVincent Cohen-Addad, Kasper Green Larsen, David Saulpic, Chris Schwiegelshohn et al.NeurIPS 2022 · 47 citations
- Sketching Algorithms for Sparse Dictionary Learning: PTAS and Turnstile StreamingGregory Dexter, Petros Drineas, David P. Woodruff, Taisuke YasudaNeurIPS 2023
- Deterministic Clustering in High Dimensional Spaces: Sketches and ApproximationVincent Cohen-Addad, David Saulpic, Chris SchwiegelshohnFOCS 2023 · 3 citations
