MorphStore: Analytical Query Engine with a Holistic Compression-Enabled Processing Model
Patrick Damme, Annett Ungethüm, Johannes Pietrzyk, Alexander Krause, Dirk Habich, Wolfgang Lehner
Abstract
In this paper, we present MorphStore, an open-source inmemory columnar analytical query engine with a novel holistic compression-enabled processing model. Basically, compression using lightweight integer compression algorithms already plays an important role in existing in-memory columnstore database systems, but mainly for base data. In particular, during query processing, these systems only keep the data compressed until an operator cannot process the compressed data directly, whereupon the data is decompressed, but not recompressed. Thus, the full potential of compression during query processing is not exploited. To overcome that, we developed a novel compression-enabled processing model as presented in this paper. As we are going to show, the continuous usage of compression for all base data and all intermediates is very beneficial to reduce the overall memory footprint as well as to improve the query performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a7779a51-513b-4350-bf22-ba436b3a2208Cited by top-tier papers6
- Good to the Last Bit: Data-Driven Encoding with CodecDBHao Jiang, Chunwei Liu, John Paparrizos, Andrew A. Chien et al.SIGMOD 2021 · 45 citations
- LeCo: Lightweight Compression via Learning Serial CorrelationsYihao Liu, Xinyu Zeng, Huanchen ZhangSIGMOD 2024 · 17 citations
- AWARE: Workload-aware, Redundancy-exploiting Linear AlgebraSebastian Baunsgaard, Matthias BoehmSIGMOD 2023 · 4 citations
- GPU Acceleration of SQL Analytics on Compressed DataZezhou Huang, Krystian Sakowski, Hans Lehnert, Wei Cui et al.VLDB 2026 · 1 citation
- L3: A GPU-Native Co-Designed Data Format for Learned Lossless Lightweight CompressionYouyang Xia, Feng Zhang, Junda Pan, Yihao Liu et al.SIGMOD 2026 · 1 citation
Related papers
- Columnar Storage and List-based Processing for Graph Database Management SystemsPranjal Gupta, Amine Mhedhbi, Semih SalihogluVLDB 2021 · 31 citations
- Mainlining Databases: Supporting Fast Transactional Workloads on Universal Columnar Data File FormatsTianyu Li, Matthew Butrovich, Amadou Ngom, Wan Shen Lim et al.VLDB 2021 · 28 citations
- Blitzcrank: Fast Semantic Compression for In-memory Online Transaction ProcessingYiming Qiao, Yihan Gao, Huanchen ZhangVLDB 2024 · 3 citations
- Robust and Budget-Constrained Encoding Configurations for In-Memory Database SystemsMartin BoissierVLDB 2022 · 17 citations
- High-Performance Query Processing with NVMe Arrays: Spilling without Killing PerformanceMaximilian Kuschewski, Jana Giceva, Thomas Neumann, Viktor LeisSIGMOD 2025 · 11 citations
