To Share, or not to Share Online Event Trend Aggregation Over Bursty Event Streams
Olga Poppe, Chuan Lei, Lei Ma, Allison Rozet, Elke A. Rundensteiner
Abstract
Complex event processing (CEP) systems continuously evaluate large workloads of pattern queries under tight time constraints. Event trend aggregation queries with Kleene patterns are commonly used to retrieve summarized insights about the recent trends in event streams. Stateof-art methods are limited either due to repetitive computations or unnecessary trend construction. Existing shared approaches are guided by statically selected and hence rigid sharing plans that are often sub-optimal under stream fluctuations. In this work, we propose a novel framework
HAMLET that is the first to overcome these limitations. HAMLET introduces two key innovations.
First, HAMLET adaptively decides whether to share or not to share computations depending on the current stream properties at run time to harvest the maximum sharing benefit. Second, HAMLET is equipped with a highly efficient shared trend aggregation strategy that avoids trend construction. Our experimental study on both real and synthetic data sets demonstrates that HAMLET consistently reduces query latency by up to five orders of magnitude compared to the state-of-the-art approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 11113bcb-db3f-4dab-a9e2-befca71619fdCited by top-tier papers7
- CORE: a COmplex event Recognition EngineMarco Bucchi, Alejandro Grez, Andrés Quintana, Cristian Riveros et al.VLDB 2022 · 30 citations
- INEv: In-Network Evaluation for Event Stream ProcessingSamira Akili, Steven Purtzel, Matthias WeidlichSIGMOD 2023 · 13 citations
- Out-of-Order Sliding-Window Aggregation with Efficient Bulk Evictions and InsertionsKanat Tangwongsan, Martin Hirzel, Scott SchneiderVLDB 2023 · 9 citations
- DecoPa: Query Decomposition for Parallel Complex Event ProcessingSamira Akili, Steven Purtzel, Matthias WeidlichSIGMOD 2024 · 8 citations
- Gloria: Graph-based Sharing Optimizer for Event Trend AggregationLei Ma, Chuan Lei, Olga Poppe, Elke A. RundensteinerSIGMOD 2022 · 5 citations
Builds on1
Related papers
- DARLING: Data-Aware Load Shedding in Complex Event Processing SystemsKoral Chapnik, Ilya Kolchinsky, Assaf SchusterVLDB 2022 · 20 citations
- Load Shedding for Complex Event Processing: Input-based and State-based TechniquesBo Zhao, Nguyen Quoc Viet Hung, Matthias WeidlichICDE 2020 · 28 citations
- SHARP: Shared State Reduction for Efficient Matching of Sequential PatternsCong Yu, Tuo Shi, Matthias Weidlich, Bo ZhaoVLDB 2026
- EIRES: Efficient Integration of Remote Data in Event Stream ProcessingBo Zhao, Han van der Aa, Thanh Tam Nguyen, Quoc Viet Hung Nguyen et al.SIGMOD 2021 · 13 citations
- HYPERSONIC: A Hybrid Parallelization Approach for Scalable Complex Event ProcessingMaor Yankovitch, Ilya Kolchinsky, Assaf SchusterSIGMOD 2022 · 10 citations
