RekindleSketch: Time-Aware Detection of Recent Persistent Flows via Arrival-Driven Rewards
Xuyang Jing, Yingchao Dou, Jialin Dong, Zheng Yan, Yihan Zheng, Xiangyu Wang, Cong Wang, Yang Xiao
Abstract
Recent persistent flow, which refers to a flow that remains continuously active within the most recent R windows, is an important analytical object for recognizing the network situation and detecting anomalies. Existing methods struggle to effectively detect such flows due to prohibitive memory overhead or unstable accuracy caused by arrival gaps and hash collisions in limited memory. In this paper, we propose RekindleSketch, a novel time-aware data structure designed for accurate and efficient detection of recent persistent flows. First, we define a new metric to quantify recent persistence, called memory score. Taking into account both continuity and intermittency in the last R windows, the scores of recent persistent flows are continuously rewarded, while the scores of recent inactive flows are rapidly reduced, achieving a focus on recent activity and the forgetting of historical activity. Then, taking advantage of the memory score, RekindleSketch adopts a probabilistic replacement policy that faithfully tracks recent persistent flows while rapidly evicting those that have become inactive. We provide both theoretical analysis and extensive experimental tests. Experimental results demonstrate that RekindleSketch outperforms state-of-the-art methods in terms of accuracy and efficiency. The source code of RekindleSketch is available on GitHub.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get d1a4b873-faa7-40c1-8cd3-c27eafb0b426Related papers
- PSSketch: Finding Persistent and Sparse Flow with High Accuracy and EfficiencyJiayao Wang, Qilong Shi, Xiyan Liang, Han Wang et al.KDD 2025
- Pontus: A Memory-Efficient and High-Accuracy Approach for Persistence-Based Item Lookup in High-Velocity Data StreamsWeihe Li, Zukai Li, Beyza Bütün, Alec F. Diallo et al.WWW 2025 · 4 citations
- Scout Sketch: Finding Promising Items in Data StreamsTianyu Ma, Guoju Gao, He Huang, Yu-e Sun et al.INFOCOM 2024 · 4 citations
- Persistent Items Tracking in Large Data Streams Based on Adaptive SamplingLin Chen, Raphael C.-W. Phan, Zhili Chen, Dan HuangINFOCOM 2022 · 15 citations
- On-Off Sketch: A Fast and Accurate Sketch on PersistenceYinda Zhang, Jinyang Li, Yutian Lei, Tong Yang et al.VLDB 2021 · 63 citations
