Efficient Incremental Computation of Aggregations over Sliding Windows
Chao Zhang, Reza Akbarinia, Farouk Toumani
Abstract
Computing aggregation over sliding windows, i.e., finite subsets of an unbounded stream, is a core operation in streaming analytics. We propose PBA (Parallel Boundary Aggregator), a novel parallel algorithm that groups continuous slices of streaming values into chunks and exploits two buffers, cumulative slice aggregations and left cumulative slice aggregations, to compute sliding window aggregations efficiently. PBA runs in 𝑂 (1) time, performing at most 3 merging operations per slide while consuming 𝑂 (𝑛) space for windows with 𝑛 partial aggregations. Our empirical experiments demonstrate that PBA can improve throughput up to 4× while reducing latency, compared to state-of-the-art algorithms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0c04c26d-ca7a-4e2e-8a5a-e7475741fc4cCited by top-tier papers1
Ask how each one uses itRelated papers
- Out-of-Order Sliding-Window Aggregation with Efficient Bulk Evictions and InsertionsKanat Tangwongsan, Martin Hirzel, Scott SchneiderVLDB 2023 · 9 citations
- LightSaber: Efficient Window Aggregation on Multi-core ProcessorsGeorgios Theodorakis, Alexandros Koliousis, Peter R. Pietzuch, Holger PirkSIGMOD 2020 · 36 citations
- Improved Sliding Window Algorithms for Clustering and Coverage via Bucketing-Based SketchesAlessandro Epasto, Mohammad Mahdian, Vahab S. Mirrokni, Peilin ZhongSODA 2022 · 6 citations
- SWIX: A Memory-efficient Sliding Window Learned IndexLiang Liang, Guang Yang, Ali Hadian, Luis Alberto Croquevielle et al.SIGMOD 2024 · 5 citations
- Parallel Index-based Stream Join on a Multicore CPUAmirhesam Shahvarani, Hans-Arno JacobsenSIGMOD 2020 · 20 citations
