Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning
Donghe Kang, Ruochen Jiang, Spyros Blanas
Abstract
The physical data layout significantly impacts performance when database systems access cold data. In addition to the traditional row store and column store designs, recent research proposes to partition tables hierarchically, starting from either horizontal or vertical partitions and then determining the best partitioning strategy on the other dimension independently for each partition. All these partitioning strategies naturally produce rectangular partitions. Coarse-grained rectangular partitioning reads unnecessary data when a table cannot be partitioned along one dimension for all queries. Fine-grained rectangular partitioning produces many small partitions which negatively impacts I/O performance and possibly introduces a high tuple reconstruction overhead.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers5
- A Deep Dive into Common Open Formats for Analytical DBMSsChunwei Liu, Anna Pavlenko, Matteo Interlandi, Brandon HaynesVLDB 2023 · 23 citations
- Proteus: Autonomous Adaptive Storage for Mixed WorkloadsMichael Abebe, Horatiu Lazu, Khuzaima DaudjeeSIGMOD 2022 · 20 citations
- Grouping Time Series for Efficient Columnar StorageChenguang Fang, Shaoxu Song, Haoquan Guan, Xiangdong Huang et al.SIGMOD 2023 · 10 citations
- Partition, Don't Sort! Compression Boosters for Cloud Data Ingestion PipelinesPatrick Hansert, Sebastian MichelVLDB 2024 · 2 citations
- Prefix-Cache-Aware Data Reordering for LLM-Augmented Database AnalyticsYingze Li, dong wang, Yiming Guo, Yao Chen et al.ICML 2026
Related papers
- Pando: Enhanced Data Skipping with Logical Data PartitioningSivaprasad Sudhir, Wenbo Tao, Nikolay Pavlovich Laptev, Cyrille Habis et al.VLDB 2023 · 14 citations
- MorphoSys: Automatic Physical Design Metamorphosis for Distributed Database SystemsMichael Abebe, Brad Glasbergen, Khuzaima DaudjeeVLDB 2020 · 18 citations
- Dynamic Data Layout Optimization with Worst-Case GuaranteesKexin Rong, Paul Liu, Sarah Ashok Sonje, Moses CharikarICDE 2024 · 1 citation
- Robust Performance of Main Memory Data Structures by ConfigurationTiemo Bang, Ismail Oukid, Norman May, Ilia Petrov et al.SIGMOD 2020 · 6 citations
- Rethink Query Optimization in HTAP DatabasesHaoze Song, Wenchao Zhou, Feifei Li, Xiang Peng et al.SIGMOD 2024 · 7 citations
