Space Lower Bounds for Dynamic Filters and Value-Dynamic Retrieval
William Kuszmaul, Stefan Walzer
Abstract
A filter is a data structure that answers approximate-membership queries on a set of elements, with a false-positive rate of . A filter is said to be dynamic if it supports insertions/deletions to the set , subject to a capacity constraint of .
This paper considers the space requirement of filters, regardless of running time. It has been known for decades that static filters have optimal space log -1 + (1) expected bits, and that dynamic filters can be implemented in space log -1 + Θ( ) bits. We prove that this Θ( )-bit gap is fundamental: any dynamic filter must use log -1 + Ω( ) bits, no matter the choice of . Extending our techniques, we are also able to obtain a lower bound for the value-dynamic retrieval problem. Here again, we show that there is a Θ( )-bit gap between the optimal static and (value-)dynamic solutions.
• Theory of computation → Data structures design and analysis; Cell probe models and lower bounds.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Fingerprint Filters Are OptimalWilliam Kuszmaul, Jingxun Liang, Renfei ZhouFOCS 2025 · 4 citations
- Tight Bounds and Phase Transitions for Incremental and Dynamic RetrievalWilliam Kuszmaul, Aaron Putterman, Tingqiang Xu, Hangrui Zhou et al.SODA 2025 · 1 citation
- Static Retrieval Revisited: To Optimality and BeyondYang Hu, William Kuszmaul, Jingxun Liang, Huacheng Yu et al.FOCS 2025 · 1 citation
- Hallucination is a Consequence of Space-Optimality: A Rate-Distortion Theorem for Membership TestingAnxin Guo, Jingwei LiICML 2026
Builds on2
- Vector Quotient Filters: Overcoming the Time/Space Trade-Off in Filter DesignPrashant Pandey, Alex Conway, Joe Durie, Michael A. Bender et al.SIGMOD 2021 · 40 citations
- On the optimal time/space tradeoff for hash tablesMichael A. Bender, Martin Farach-Colton, John Kuszmaul, William Kuszmaul et al.STOC 2022 · 20 citations
Related papers
- Aleph Filter: To Infinity in Constant TimeNiv Dayan, Ioana Oriana Bercea, Rasmus PaghVLDB 2024 · 13 citations
- Tight Cell-Probe Lower Bounds for Dynamic Succinct DictionariesTianxiao Li, Jingxun Liang, Huacheng Yu, Renfei ZhouFOCS 2023 · 11 citations
- InfiniFilter: Expanding Filters to Infinity and BeyondNiv Dayan, Ioana O. Bercea, Pedro Reviriego, Rasmus PaghSIGMOD 2023 · 27 citations
- Lower bound for succinct range minimum queryMingmou Liu, Huacheng YuSTOC 2020 · 7 citations
- Prefix Filter: Practically and Theoretically Better Than BloomTomer Even, Guy Even, Adam MorrisonVLDB 2022 · 13 citations
