PeriodicSketch: Finding Periodic Items in Data Streams
Zhuochen Fan, Yinda Zhang, Tong Yang, Mingyi Yan, Gang Wen, Yuhan Wu, Hongze Li, Bin Cui
Abstract
In this paper, we study periodic items in data streams, which refer to those items arriving with a fixed interval. All existing works involving mining periodic patterns does not fit for data stream scenarios. To find periodic items in real time, we propose a novel sketch, PeriodicSketch, aiming to accurately record top-periodic items. To the best of our knowledge, this is the first work to find periodic items in data streams. Any interval may occur many times, and we use frequency to denote the number of an interval occurred. To pick out periodic items with high frequency, we propose a key technique called Guaranteed Soft Uniform (GSU) replacement strategy. Our theoretical proofs show that when replacement is successful, it is more likely that the new item has a higher frequency than the current smallest frequency; and GSU can ensure that our items in the sketch will approach the true periodic items closer and closer. And as soon as we get all the periodic items, the state would not change worse with high probability. We conduct extensive experiments, and the experimental results show that the Average Absolute Error (AAE) of our sketch using 1/10 memory is around 737 times (up to 2019 times) lower than the baseline solution. Finally, we provide a concrete case: Cache prefetch, which proves that PeriodicSketch can significantly improve the Cache hit ratio. All related codes of PeriodicSketch are open-sourced and available at GitHub [1].
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4af26f6a-4611-47e6-aea9-58cefa6992e7Cited by top-tier papers2
- HyperCalm Sketch: One-Pass Mining Periodic Batches in Data StreamsZirui Liu, Chaozhe Kong, Kaicheng Yang, Tong Yang et al.ICDE 2023 · 16 citations
- Measuring Item Freshness in Data StreamsZirui Liu, Zihan Jiang, An Zhang, Zhouran Shi et al.KDD 2025
Builds on3
- LightGuardian: A Full-Visibility, Lightweight, In-band Telemetry System Using SketchletsYikai Zhao, Kaicheng Yang, Zirui Liu, Tong Yang et al.NSDI 2021 · 131 citations
- On-Off Sketch: A Fast and Accurate Sketch on PersistenceYinda Zhang, Jinyang Li, Yutian Lei, Tong Yang et al.VLDB 2021 · 63 citations
- Out of Many We are One: Measuring Item Batch with Clock-SketchPeiqing Chen, Dong Chen, Lingxiao Zheng, Jizhou Li et al.SIGMOD 2021 · 35 citations
Related papers
- PBSketch: Finding Periodic Burst Items in Data StreamsZhuochen Fan, Zhongxian Liang, Zirui Liu, Dayu Wang et al.KDD 2026
- WavingSketch: An Unbiased and Generic Sketch for Finding Top-k Items in Data StreamsJizhou Li, Zikun Li, Yifei Xu, Shiqi Jiang et al.KDD 2020 · 96 citations
- BurstSketch: Finding Bursts in Data StreamsZheng Zhong, Shen Yan, Zikun Li, Decheng Tan et al.SIGMOD 2021 · 58 citations
- Scout Sketch: Finding Promising Items in Data StreamsTianyu Ma, Guoju Gao, He Huang, Yu-e Sun et al.INFOCOM 2024 · 4 citations
- Finding Simplex Items in Data StreamsZhuochen Fan, Jiarui Guo, Xiaodong Li, Tong Yang et al.ICDE 2023 · 9 citations
