Lifting Linear Sketches: Optimal Bounds and Adversarial Robustness
Elena Gribelyuk, Honghao Lin, David P. Woodruff, Huacheng Yu, Samson Zhou
Abstract
We introduce a novel technique for "lifting" dimension lower bounds for linear sketches in the real-valued setting to dimension lower bounds for linear sketches with polynomially-bounded integer entries when the input is a polynomially-bounded integer vector. Using this technique, we obtain the first optimal sketching lower bounds for discrete inputs in a data stream, for classical problems such as approximating the frequency moments, estimating the operator norm, and compressed sensing. Additionally, we lift the adaptive attack of Hardt and Woodruff (STOC, 2013) for breaking any real-valued linear sketch via a sequence of real-valued queries, and show how to obtain an attack on any integer-valued linear sketch using integer-valued queries. This shows that there is no linear sketch in a data stream with insertions and deletions that is adversarially robust for approximating any L p norm of the input, resolving a central open question for adversarially robust streaming algorithms. To do so, we introduce a new pre-processing technique of independent interest which, given an integer-valued linear sketch, increases the dimension of the sketch by only a constant factor in order to make the orthogonal lattice to its row span smooth. This pre-processing then enables us to leverage results in lattice theory on discrete Gaussian distributions and reason that efficient discrete sketches imply efficient continuous sketches. Our work resolves open questions from the Banff '14 and '17 workshops on Communication Complexity and Applications, as well as the STOC '21 and FOCS '23 workshops on adaptivity and robustness.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 70e2e0c5-1563-483b-9c27-e8d1b07d3723Cited by top-tier papers5
- Nearly Space-Optimal Graph and Hypergraph Sparsification in Insertion-Only Data StreamsVincent Cohen-Addad, David P. Woodruff, Shenghao Xie, Samson ZhouICLR 2026 · 2 citations
- Adaptive Robustness of Hypergrid Johnson-LindenstraussAndrej Bogdanov, Alon Rosen, Neekon Vafa, Vinod VaikuntanathanSTOC 2026 · 1 citation
- The Cost of Compression: Tight Quadratic Black-Box Attacks on Sketches for ℓ2 Norm EstimationSara Ahmadian, Edith Cohen, Uri StemmerNeurIPS 2025 · 1 citation
- Adaptively Robust Resettable StreamingEdith Cohen, Elena Gribelyuk, Jelani Nelson, Uri StemmerICML 2026
- Adversarially Robust Approximate Furthest NeighborKiarash Banihashem, Jeff Michael Giliberti, Prashant Gokhale, Samira Goudarzi et al.ICML 2026
Builds on14
- The Discrete Gaussian for Differential PrivacyClément L. Canonne, Gautam Kamath, Thomas SteinkeNeurIPS 2020 · 355 citations
- Adversarially Robust Streaming Algorithms via Differential PrivacyAvinatan Hassidim, Haim Kaplan, Yishay Mansour, Yossi Matias et al.NeurIPS 2020 · 85 citations
- Adversarial Robustness of Streaming Algorithms through Importance SamplingVladimir Braverman, Avinatan Hassidim, Yossi Matias, Mariano Schain et al.NeurIPS 2021 · 56 citations
- Tight Bounds for Adversarially Robust Streams and Sliding Windows via Difference EstimatorsDavid P. Woodruff, Samson ZhouFOCS 2021 · 25 citations
- Adversarial laws of large numbers and optimal regret in online classificationNoga Alon, Omri Ben-Eliezer, Yuval Dagan, Shay Moran et al.STOC 2021 · 23 citations
Related papers
- A Strong Separation for Adversarially Robust ℓ0 Estimation for Linear SketchesElena Gribelyuk, Honghao Lin, David P. Woodruff, Huacheng Yu et al.FOCS 2024 · 2 citations
- On the Robustness of CountSketch to Adaptive InputsEdith Cohen, Xin Lyu, Jelani Nelson, Tamás Sarlós et al.ICML 2022 · 29 citations
- Tricking the Hashing Trick: A Tight Lower Bound on the Robustness of CountSketch to Adaptive InputsEdith Cohen, Jelani Nelson, Tamás Sarlós, Uri StemmerAAAI 2023 · 14 citations
- One Attack to Rule Them All: Tight Quadratic Bounds for Adaptive Queries on Cardinality SketchesEdith Cohen, Jelani Nelson, Tamás Sarlós, Mihir Singhal et al.SODA 2026
- Frequency Estimation with One-Sided ErrorPiotr Indyk, Shyam Narayanan, David P. WoodruffSODA 2022 · 1 citation
