One-Sketch: A Unified Framework for Per-Flow Cardinality Measurement with Flexible Bias Control
Kejun Guo, Fuliang Li, Jiaxing Shen, Haorui Wan, Songlin Chen, Man Hou
Abstract
In the era of massive network traffic and sophisticated cyber threats, accurate per-flow cardinality measurement has become the cornerstone of modern traffic analytics and network security. However, traditional sketch-based solutions face a fundamental dilemma: they either excel at cardinality estimation or super-spreader detection, but not both, while being limited to either biased or unbiased estimations. This limitation forces network operators to deploy multiple specialized systems, increasing complexity and resource overhead. One-Sketch represents a paradigm shift in network measurement by unifying dual functionality within a single architecture. Specifically, our approach introduces a novel hybrid design combining a heavy part for tracking elephant flows with specialized unbiased cardinality estimators for remaining traffic. This architecture delivers simultaneous high-accuracy cardinality estimation and super-spreader detection while providing flexible bias control to meet diverse application demands. Furthermore, our approach introduces a cardinality buffering technique, which dramatically enhances throughput by enabling real-time estimation capabilities that traditional single-flow estimators cannot achieve. Extensive evaluation on real-world network traces demonstrates One-Sketch’s superior performance: achieving the highest accuracy for super-spreader detection while maintaining comparable cardinality estimation precision, with significantly higher throughput than existing solutions.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get e6af104b-3344-4009-ace7-fb3e351b4135Related papers
- Couper: Memory-Efficient Cardinality Estimation under Unbalanced DistributionXun Song, Jiaqi Zheng, Hao Qian, Shiju Zhao et al.ICDE 2023 · 3 citations
- Cardinality is Not Enough: Super Host Detection via Segmented Cardinality EstimationYilin Zhao, Jiawei Huang, Xianshi Su, Weihe Li et al.WWW 2026
- Universal Online Sketch for Tracking Heavy Hitters and Estimating Moments of Data StreamsQingjun Xiao, Zhiying Tang, Shigang ChenINFOCOM 2020 · 30 citations
- Identifying Hierarchical Super Spreaders in a Data Stream by Hot-Separated and Mergeable SketchHang Chen, Qingjun Xiao, Liukun He, Yongchao Zhang et al.INFOCOM 2026
- Randomized Error Removal for Online Spread Estimation in Data StreamingHaibo Wang, Chaoyi Ma, Olufemi O. Odegbile, Shigang Chen et al.VLDB 2021 · 38 citations
