Ensemble Learned Bloom Filters: Two Oracles are Better than One
Ming Lin, Lin Chen
Abstract
Bloom filters (BF) are space-efficient probabilistic data structures for approximate membership testing. Boosted by the proliferation of machine learning, learned Bloom filters (LBF) were recently proposed by augmenting the canonical BFs with a learned oracle as a pre-filter, the size of which is crucial to the compactness of the overall system. In this paper, inspired by ensemble learning, we depart from the state-of-the-art singleoracle LBF structure by demonstrating that, by leveraging multiple learning oracles of smaller size and carefully optimizing the accompanied backup filters, we can significantly boost the performance of LBF under the same space budget. We then design and optimize ensemble learned Bloom filters for mutually independent and correlated learning oracles respectively. We also empirically demonstrate the performance improvement of our propositions under three practical data analysis tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6870ca77-a4c1-4d11-aa8c-9a8e62020608Builds on4
- Non-Gaussian Gaussian Processes for Few-Shot RegressionMarcin Sendera, Jacek Tabor, Aleksandra Nowak, Andrzej Bedychaj et al.NeurIPS 2021 · 23 citations
- Fast Partitioned Learned Bloom FilterAtsuki Sato, Yusuke MatsuiNeurIPS 2023 · 13 citations
- Adaptive Learned Bloom Filter (Ada-BF): Efficient Utilization of the Classifier with Application to Real-Time Information Filtering on the WebZhenwei Dai, Anshumali ShrivastavaNeurIPS 2020 · 7 citations
- Partitioned Learned Bloom FiltersKapil Vaidya, Eric Knorr, Michael Mitzenmacher, Tim KraskaICLR 2021 · 2 citations
Related papers
- Stable Learned Bloom Filters for Data StreamsQiyu Liu, Libin Zheng, Yanyan Shen, Lei ChenVLDB 2020 · 45 citations
- New Wine in an Old Bottle: Data-aware Hash Functions for Bloom FiltersArindam Bhattacharya, Chathur Gudesa, Amitabha Bagchi, Srikanta BedathurVLDB 2022 · 6 citations
- Hash Adaptive Bloom FilterRongbiao Xie, Meng Li, Zheyu Miao, Rong Gu et al.ICDE 2021 · 23 citations
- A Learned Cuckoo Filter for Approximate Membership Queries over Variable-sized Sliding Windows on Data StreamsYao Tian, Tingyun Yan, Ruiyuan Zhang, Kai Huang et al.SIGMOD 2024 · 7 citations
- Oasis: An Optimal Disjoint Segmented Learned Range FilterGuanduo Chen, Meng Li, Siqiang Luo, Zhenying HeVLDB 2024 · 17 citations
