Hyper-USS: Answering Subset Query Over Multi-Attribute Data Stream
Ruijie Miao, Yiyao Zhang, Guanyu Qu, Kaicheng Yang, Tong Yang, Bin Cui
Abstract
1 Sketching algorithms are considered as promising solutions for answering approximate query on massive data stream. In real scenarios, a large number of problems can be abstracted as subset query over multiple attributes. Existing sketches are designed for query on single attributes, and therefore are inefficient for query on multiple attributes. In this work, we propose Hyper-USS, an innovative sketching algorithm that supports subset query over multiple attributes accurately and efficiently. To the best of our knowledge, this work is the first sketching algorithm designed to answer approximate query over multi-attribute data stream. We utilize the key technique, Joint Variance Optimization, to guarantee high estimation accuracy on all attributes. Experiment results show that, compared with the state-of-the-art (SOTA) sketches that support subset query on single attributes, Hyper-USS improves the accuracy by 16.67× and the throughput by 8.54×. The code is open-sourced at Github.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Learning Multi-Dimensional IndexesVikram Nathan, Jialin Ding, Mohammad Alizadeh, Tim KraskaSIGMOD 2020 · 180 citations
- CocoSketch: high-performance sketch-based measurement over arbitrary partial key queryYinda Zhang, Zaoxing Liu, Ruixin Wang, Tong Yang et al.SIGCOMM 2021 · 146 citations
- WavingSketch: An Unbiased and Generic Sketch for Finding Top-k Items in Data StreamsJizhou Li, Zikun Li, Yifei Xu, Shiqi Jiang et al.KDD 2020 · 96 citations
- Sliding Sketches: A Framework using Time Zones for Data Stream Processing in Sliding WindowsXiangyang Gou, Long He, Yinda Zhang, Ke Wang et al.KDD 2020 · 53 citations
- DHS: Adaptive Memory Layout Organization of Sketch Slots for Fast and Accurate Data Stream ProcessingBohan Zhao, Xiang Li, Boyu Tian, Zhiyu Mei et al.KDD 2021 · 47 citations
Related papers
- Convolution and Cross-Correlation of Count Sketches Enables Fast Cardinality Estimation of Multi-Join QueriesMike Heddes, Igor Nunes, Tony Givargis, Alex NicolauSIGMOD 2024 · 5 citations
- OmniSketch: Efficient Multi-Dimensional High-Velocity Stream Analytics with Arbitrary PredicatesWieger R. Punter, Odysseas Papapetrou, Minos N. GarofalakisVLDB 2024 · 10 citations
- LETFramework: Let the Universal Sketch be AccurateRuijie Miao, Xiangwei Deng, Zicang Xu, Ziyun Zhang et al.ICDE 2025
- JoinSketch: A Sketch Algorithm for Accurate and Unbiased Inner-Product EstimationFeiyu Wang, Qizhi Chen, Yuanpeng Li, Tong Yang et al.SIGMOD 2023 · 20 citations
- Efficient framework for operating on data sketchesJakub LemieszVLDB 2023 · 6 citations
