STEM2: A Fast and Space-efficient Data Structure for Exact Multi-Set Membership Query
Yannian Niu, Song Han, Minmei Wang
Abstract
Multi-set membership queries are ubiquitous in networking and database systems. Current solutions force a difficult compromise: hash tables guarantee correctness but suffer from high memory footprints, while filter-based approaches optimize space at the cost of probabilistic errors. In this paper, we propose STEM 2 , a fast and space-efficient data structure that achieves 100% query accuracy and can support dynamic key updates for multi-set membership queries. STEM 2 utilizes a balanced binary tree architecture where each non-leaf node incorporates a novel Exact Binary Set Separator (XBSS) to partition keys into two disjoint groups. A key innovation of our design is a minimized hashing scheme that requires only two hash computations per key lookup, significantly reducing computational overhead. Additionally, STEM 2 separates the control plane and the data plane: the control plane handles construction and dynamic updates, while the data plane is dedicated to serving efficient membership queries. Extensive experiments show that STEM 2 achieves over 120 million operations per second (Mops) in lookup throughput, outperforming the state-of-the-art Coloring Embedder by 20% and the Ludo hashing by up to 21.6×, while maintaining compact memory cost and exact correctness.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on4
- CRLite: A Scalable System for Pushing All TLS Revocations to All BrowsersJames Larisch, David R. Choffnes, Dave Levin, Bruce M. Maggs et al.S&P 2017 · 105 citations
- Building Fast and Compact Sketches for Approximately Multi-Set Multi-Membership QueryingRundong Li, Pinghui Wang, Jiongli Zhu, Junzhou Zhao et al.SIGMOD 2021 · 20 citations
- Simple, Fast Malicious Multiparty Private Set IntersectionOfri Nevo, Ni Trieu, Avishay YanaiCCS 2021 · 2 citations
- Linear Private Set Union from Multi-Query Reverse Private Membership TestCong Zhang, Yu Chen, Weiran Liu, Min Zhang et al.USENIX Security 2023
Related papers
- L4g: Two-Hop Label Management for Group Steiner Tree Search on GraphsXiaoyao Feng, Yahui Sun, Zhuoran Wang, Junlin Li et al.ICDE 2026
- The Logarithmic Dynamic Cuckoo FilterFan Zhang, Hanhua Chen, Hai Jin, Pedro ReviriegoICDE 2021 · 23 citations
- STEM: Streaming-Based FPGA Acceleration for Large-Scale Compactions in LSM KVDongdong Tang, Weilan Wang, Yu Mao, Jinghuan Yu et al.ICDE 2024 · 9 citations
- ChainedFilter: Combining Membership Filters by Chain RuleHaoyu Li, Liuhui Wang, Qizhi Chen, Jianan Ji et al.SIGMOD 2024 · 5 citations
- Single Update Sketch with Variable Counter StructureDimitrios Melissourgos, Haibo Wang, Shigang Chen, Chaoyi Ma et al.VLDB 2023 · 16 citations
