Toward Nearly-Zero-Error Sketching via Compressive Sensing
Qun Huang, Siyuan Sheng, Xiang Chen, Yungang Bao, Rui Zhang, Yanwei Xu, Gong Zhang
Abstract
Sketch algorithms have been extensively studied in the area of network measurement, given their limited resource usage and theoretically bounded errors. However, error bounds provided by existing algorithms remain too coarse-grained: in practice, only a small number of flows (e.g., heavy hitters) actually benefit from the bounds, while the remaining flows still suffer from serious errors. In this paper, we aim to design a nearly-zero-error sketch that achieves negligible per-flow error for almost all flows. We base our study on a technique named compressive sensing. We exploit compressive sensing in two aspects. First, we incorporate the near-perfect recovery of compressive sensing to boost sketch accuracy. Second, we leverage compressive sensing as a novel and uniform methodology to analyze various design choices of sketch algorithms. Guided by the analysis, we propose two sketch algorithms that seamlessly embrace compressive sensing to reach nearly zero errors. We implement our algorithms in OpenVSwitch and P4. Experimental results show that the two algorithms incur less than 0.1% per-flow error for more than 99.72% flows, while preserving the resource efficiency of sketch algorithms. The efficiency demonstrates the power of our new methodology for sketch analysis and design.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e1c584d8-56c3-423a-8b0e-9286d2ce4265Cited by top-tier papers13
- LightGuardian: A Full-Visibility, Lightweight, In-band Telemetry System Using SketchletsYikai Zhao, Kaicheng Yang, Zirui Liu, Tong Yang et al.NSDI 2021 · 131 citations
- ChameleMon: Shifting Measurement Attention as Network State ChangesKaicheng Yang, Yuhan Wu, Ruijie Miao, Tong Yang et al.SIGCOMM 2023 · 32 citations
- μMon: Empowering Microsecond-level Network Monitoring with WaveletsHao Zheng, Chengyuan Huang, Xiangyu Han, Jiaqi Zheng et al.SIGCOMM 2024 · 26 citations
- Meissa: scalable network testing for programmable data planesNaiqian Zheng, Mengqi Liu, Ennan Zhai, Hongqiang Harry Liu et al.SIGCOMM 2022 · 17 citations
- LadderFilter: Filtering Infrequent Items with Small Memory and Time OverheadYuanpeng Li, Feiyu Wang, Xiang Yu, Yilong Yang et al.SIGMOD 2023 · 16 citations
Related papers
- BitSense: Universal and Nearly Zero-Error Optimization for Sketch Counters with Compressive SensingRui Ding, Shibo Yang, Xiang Chen, Qun HuangSIGCOMM 2023 · 25 citations
- SketchLib: Enabling Efficient Sketch-based Monitoring on Programmable SwitchesHun Namkung, Zaoxing Liu, Daehyeok Kim, Vyas Sekar et al.NSDI 2022
- CocoSketch: high-performance sketch-based measurement over arbitrary partial key queryYinda Zhang, Zaoxing Liu, Ruixin Wang, Tong Yang et al.SIGCOMM 2021 · 146 citations
- Sketchovsky: Enabling Ensembles of Sketches on Programmable SwitchesHun Namkung, Zaoxing Liu, Daehyeok Kim, Vyas Sekar et al.NSDI 2023 · 44 citations
- Effective Network-Wide Traffic Measurement: A Lightweight Distributed Sketch DeploymentFuliang Li, Kejun Guo, Jiaxing Shen, Xingwei WangINFOCOM 2024 · 14 citations
