SketchPolymer: Estimate Per-item Tail Quantile Using One Sketch
Jiarui Guo, Yisen Hong, Yuhan Wu, Yunfei Liu, Tong Yang, Bin Cui
Abstract
1 Estimating the quantile of distribution, especially tail distribution, is an interesting topic in data stream models, and has obtained extensive interest from many researchers. In this paper, we propose a novel sketch, namely SketchPolymer to accurately estimate per-item tail quantile. SketchPolymer uses a technique called Early Filtration to filter infrequent items, and another technique called VSS to reduce error. Our experimental results show that the accuracy of SketchPolymer is on average 32.67 times better than state-of-the-art techniques. We also implement our SketchPolymer on P4 and FPGA platforms to verify its deployment flexibility. All our codes are available at GitHub [1].
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 08d9c283-fa67-47c0-be0e-a30b537b5c6eCited by top-tier papers5
- M4: A Framework for Per-Flow Quantile EstimationSiyuan Dong, Zhuochen Fan, Tianyu Bai, Tong Yang et al.ICDE 2024 · 7 citations
- ChainedFilter: Combining Membership Filters by Chain RuleHaoyu Li, Liuhui Wang, Qizhi Chen, Jianan Ji et al.SIGMOD 2024 · 5 citations
- SplineSketch: Even More Accurate Quantiles with Error GuaranteesAleksander Lukasiewicz, Jakub Tetek, Pavel VeselýSIGMOD 2026 · 1 citation
- SketchFeature: High-Quality Per-Flow Feature Extractor Towards Security-Aware Data PlaneSian Kim, Seyed Mohammad Mehdi Mirnajafizadeh, Bara Kim, Rhongho Jang et al.NDSS 2025
- Defeating Slow-and-Low Threats via Diffusion Model-based Generative InferenceSeyed Mohammad Mehdi Mirnajafizadeh, Prashant Khanduri, DaeHun Nyang, Rhongho JangNSDI 2026
Builds on4
- Stingy Sketch: A Sketch Framework for Accurate and Fast Frequency EstimationHaoyu Li, Qizhi Chen, Yixin Zhang, Tong Yang et al.VLDB 2022 · 54 citations
- KLL±: Approximate Quantile Sketches over Dynamic DatasetsFuheng Zhao, Sujaya Maiyya, Ryan Weiner, Divy Agrawal et al.VLDB 2021 · 36 citations
- Scalable Tail Latency Estimation for Data Center NetworksKevin Zhao, Prateesh Goyal, Mohammad Alizadeh, Thomas E. AndersonNSDI 2023 · 30 citations
- HistSketch: A Compact Data Structure for Accurate Per-Key Distribution MonitoringJintao He, Jiaqi Zhu, Qun HuangICDE 2023 · 21 citations
Related papers
- Cooled-KLL: Enhancing Quantile Estimation by Filtering Hot ItemQilong Shi, Wei Zhou, Yizhuo Zheng, Xinye Xu et al.KDD 2025
- The Stair Sketch: Bringing more Clarity to Memorize Recent EventsYikai Zhao, Yubo Zhang, Pu Yi, Tong Yang et al.ICDE 2022 · 13 citations
- Near-Optimal Relative Error Streaming Quantile Estimation via Elastic CompactorsElena Gribelyuk, Pachara Sawettamalya, Hongxun Wu, Huacheng YuSODA 2025 · 1 citation
- WavingSketch: An Unbiased and Generic Sketch for Finding Top-k Items in Data StreamsJizhou Li, Zikun Li, Yifei Xu, Shiqi Jiang et al.KDD 2020 · 96 citations
- Measuring Item Freshness in Data StreamsZirui Liu, Zihan Jiang, An Zhang, Zhouran Shi et al.KDD 2025
