Change Propagation Without Joins
Qichen Wang, Xiao Hu, Binyang Dai, Ke Yi
Abstract
We revisit the classical change propagation framework for query evaluation under updates. The standard framework takes a query plan and materializes the intermediate views, which incurs high polynomial costs in both space and time, with the join operator being the culprit. In this paper, we propose a new change propagation framework without joins, thus naturally avoiding this polynomial blowup. Meanwhile, we show that the new framework still supports constant-delay enumeration of both the deltas and the full query results, the same as in the standard framework. Furthermore, we provide a quantitative analysis of its update cost, which not only recovers many recent theoretical results on the problem, but also yields an effective approach to optimizing the query plan. The new framework is also easy to be integrated into an existing streaming database system. Experimental results show that our system prototype, implemented using Flink DataStream API, significantly outperforms other systems in terms of space, time, and latency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 753015c9-a41e-409b-92f5-9eff8adbc132Cited by top-tier papers6
- Robust Join Processing with Diamond Hardened JoinsAltan Birler, Alfons Kemper, Thomas NeumannVLDB 2024 · 23 citations
- Continual Observation of Joins under Differential PrivacyWei Dong, Zijun Chen, Qiyao Luo, Elaine Shi et al.SIGMOD 2024 · 9 citations
- Avoiding Materialisation for Guarded Aggregate QueriesMatthias Lanzinger, Reinhard Pichler, Alexander SelzerVLDB 2025 · 7 citations
- Yannakakis+: Practical Acyclic Query Evaluation with Theoretical GuaranteesQichen Wang, Bingnan Chen, Binyang Dai, Ke Yi et al.SIGMOD 2025 · 7 citations
- Reservoir Sampling over JoinsBinyang Dai, Xiao Hu, Ke YiSIGMOD 2024 · 6 citations
Builds on1
Related papers
- AJoin: Ad-hoc Stream Joins at ScaleJeyhun Karimov, Tilmann Rabl, Volker MarklVLDB 2020 · 14 citations
- Is Integer Linear Programming All You Need for Deletion Propagation? A Unified and Practical Approach for Generalized Deletion PropagationNeha Makhija, Wolfgang GatterbauerVLDB 2025 · 3 citations
- Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join ModelQihang Wang, Decheng Zuo, Zhan Zhang, Yanjun Shu et al.SIGMOD 2024
- Incorporating Super-Operators in Big-Data Query OptimizersJyoti Leeka, Kaushik RajanVLDB 2020 · 17 citations
- FactorJoin: A New Cardinality Estimation Framework for Join QueriesZiniu Wu, Parimarjan Negi, Mohammad Alizadeh, Tim Kraska et al.SIGMOD 2023 · 54 citations
