Foreign Keys Open the Door for Faster Incremental View Maintenance
Christoforos Svingos, André Hernich, Hinnerk Gildhoff, Yannis Papakonstantinou, Yannis E. Ioannidis
摘要
Serverless cloud-based warehousing systems enable users to create materialized views in order to speed up predictable and repeated query workloads. Incremental view maintenance (IVM) minimizes the time needed to bring a materialized view up-to-date. It allows the refresh of a materialized view solely based on the base table changes since the last refresh. In serverless cloud-based warehouses, IVM uses computations defined as SQL scripts that update the materialized view based on updates to its base tables. However, the scripts set up for materialized views with inner joins are not optimal in the presence of foreign key constraints. For instance, for a join of two tables, the state of the art IVM computations use a UNION ALL operator of two joins - one computing the contributions to the join from updates to the first table and the other one computing the remaining contributions from the second table. Knowing that one of the join keys is a foreign-key would allow us to prune all but one of the UNION ALL branches and obtain a more efficient IVM script. In this work, we explore ways of incorporating knowledge about foreign key into IVM in order to speed up its performance. Experiments in Redshift showed that the proposed technique improved the execution times of the whole refresh process up to 2 times, and up to 2.7 times the process of calculating the necessary changes that will be applied into the materialized view.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper1
问问它们各自怎么用它相关 Paper
- Thrifty Query Execution via IncrementabilityDixin Tang, Zechao Shang, Aaron J. Elmore, Sanjay Krishnan 等SIGMOD 2020 · 被引用 9 次
- S/C: Speeding up Data Materialization with Bounded MemoryZhaoheng Li, Xinyu Pi, Yongjoo ParkICDE 2023 · 被引用 7 次
- Tempura: A General Cost-Based Optimizer Framework for Incremental Data ProcessingZuozhi Wang, Kai Zeng, Botong Huang, Wei Chen 等VLDB 2021 · 被引用 9 次
- DBSP: Automatic Incremental View Maintenance for Rich Query LanguagesMihai Budiu, Tej Chajed, Frank McSherry, Leonid Ryzhyk 等VLDB 2023 · 被引用 41 次
- Mashup: making serverless computing useful for HPC workflows via hybrid executionRohan Basu Roy, Tirthak Patel, Vijay Gadepally, Devesh TiwariPPoPP 2022 · 被引用 53 次
