Fast concurrent data sketches
Arik Rinberg, Alexander Spiegelman, Edward Bortnikov, Eshcar Hillel, Idit Keidar, Lee Rhodes, Hadar Serviansky
Abstract
Data sketches are approximate succinct summaries of long data streams. They are widely used for processing massive amounts of data and answering statistical queries about it. Existing libraries producing sketches are very fast, but do not allow parallelism for creating sketches using multiple threads or querying them while they are being built. We present a generic approach to parallelising data sketches efficiently and allowing them to be queried in real time, while bounding the error that such parallelism introduces. Utilising relaxed semantics and the notion of strong linearisability we prove our algorithm's correctness and analyse the error it induces in two specific sketches. Our implementation achieves high scalability while keeping the error small. We have contributed one of our concurrent sketches to the open-source data sketches library.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a4b72657-ef8a-43bf-a13c-277760f45ec0Cited by top-tier papers4
- SwiSh: Distributed Shared State Abstractions for Programmable SwitchesLior Zeno, Dan R. K. Ports, Jacob Nelson, Daehyeok Kim et al.NSDI 2022 · 38 citations
- SketchConf: A Framework for Automatic Sketch ConfigurationRuijie Miao, Fenghao Dong, Yikai Zhao, Yiming Zhao et al.ICDE 2023 · 11 citations
- Cuckoo Heavy Keeper and the balancing act of maintaining heavy hitters in stream processingVinh Quang Ngo, Marina PapatriantafilouVLDB 2025 · 2 citations
- Sublime: Sublinear Error & Space for Unbounded Skewed StreamsNavid Eslami, Ioana O. Bercea, Rasmus Pagh, Niv DayanSIGMOD 2026
Related papers
- Delegation sketch: a parallel design with support for fast and accurate concurrent operationsCharalampos Stylianopoulos, Ivan Walulya, Magnus Almgren, Olaf Landsiedel et al.EuroSys 2020 · 7 citations
- Optimistic Data Parallelism for FPGA-Accelerated SketchingMartin Kiefer, Ilias Poulakis, Eleni Tzirita Zacharatou, Volker MarklVLDB 2023 · 11 citations
- AlignSketch: A Framework for Aligning Theoretical and Practical Estimation ErrorsCe Zheng, Hanyue Zheng, Jingwei Shi, Xinye Xu et al.ICDE 2026
- Sketch-Flip-Merge: Mergeable Sketches for Private Distinct CountingJonathan Hehir, Daniel Ting, Graham CormodeICML 2023 · 12 citations
- OmniSketch: Efficient Multi-Dimensional High-Velocity Stream Analytics with Arbitrary PredicatesWieger R. Punter, Odysseas Papapetrou, Minos N. GarofalakisVLDB 2024 · 10 citations
