Unraveling the Impact of Window Semantics: Optimizing Join Order for Efficient Stream Processing
Ariane Ziehn, Jan Szlang, Steffen Zeuch, Volker Markl
Abstract
Window joins (WJs) are fundamental operators in stream processing systems (SPSs), enabling continuous, time-aware joins over unbounded data streams. Unlike time-agnostic relational joins, WJs incorporate temporal semantics associated with different window types (i.e., sliding, session, and interval windows), which introduce uncertainty in algebraic properties such as commutativity and associativity. As a result, state-of-the-art SPSs exploit only a single, fixed join order, which limits optimization opportunities and often leads to suboptimal performance. In this work, we eliminate this restriction by introducing three transformation rules that enable WJ reordering while preserving query semantics for those window types. Based on them, we propose WJR , an algorithm that systematically enumerates semantically equivalent join orders, expanding the search space for finding efficient WJ execution plans. Our evaluation shows speedups of up to 10 for multi-way WJ queries under various window configurations and rate ratios, highlighting the performance benefits of flexible join reordering in streaming queries.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 225b0b62-c97e-4f5a-bfef-36d839acd942Builds on5
- Grizzly: Efficient Stream Processing Through Adaptive Query CompilationPhilipp M. Grulich, Sebastian Breß, Steffen Zeuch, Jonas Traub et al.SIGMOD 2020 · 41 citations
- Parallel Index-based Stream Join on a Multicore CPUAmirhesam Shahvarani, Hans-Arno JacobsenSIGMOD 2020 · 20 citations
- Rethinking Stateful Stream Processing with RDMABonaventura Del Monte, Steffen Zeuch, Tilmann Rabl, Volker MarklSIGMOD 2022 · 13 citations
- MuSE Graphs for Flexible Distribution of Event Stream Processing in NetworksSamira Akili, Matthias WeidlichSIGMOD 2021 · 11 citations
- TiLT: A Time-Centric Approach for Stream Query Optimization and ParallelizationAnand Jayarajan, Wei Zhao, Yudi Sun, Gennady PekhimenkoASPLOS 2023 · 6 citations
Related papers
- Parallelizing Intra-Window Join on Multicores: An Experimental StudyShuhao Zhang, Yancan Mao, Jiong He, Philipp M. Grulich et al.SIGMOD 2021 · 16 citations
- StreamQL: a query language for processing streaming time seriesLingkun Kong, Konstantinos MamourasOOPSLA 2020 · 8 citations
- Factor Windows: Cost-based Query Rewriting for Optimizing Correlated Window AggregatesWentao Wu, Philip A. Bernstein, Alex Raizman, Christina PavlopoulouICDE 2022 · 4 citations
- Incorporating Super-Operators in Big-Data Query OptimizersJyoti Leeka, Kaushik RajanVLDB 2020 · 17 citations
- LightSaber: Efficient Window Aggregation on Multi-core ProcessorsGeorgios Theodorakis, Alexandros Koliousis, Peter R. Pietzuch, Holger PirkSIGMOD 2020 · 36 citations
