Scalable Garbage Collection for In-Memory MVCC Systems
Jan Böttcher, Viktor Leis, Thomas Neumann, Alfons Kemper
Abstract
To support Hybrid Transaction and Analytical Processing (HTAP), database systems generally rely on Multi-Version Concurrency Control (MVCC). While MVCC elegantly enables lightweight isolation of readers and writers, it also generates outdated tuple versions, which, eventually, have to be reclaimed. Surprisingly, we have found that in HTAP workloads, this reclamation of old versions, i.e., garbage collection, often becomes the performance bottleneck. It turns out that in the presence of long-running queries, state-of-the-art garbage collectors are too coarse-grained. As a consequence, the number of versions grows quickly slowing down the entire system. Moreover, the standard background cleaning approach makes the system vulnerable to sudden spikes in workloads. In this work, we propose a novel garbage collection (GC) approach that prunes obsolete versions eagerly. Its seamless integration into the transaction processing keeps the GC overhead minimal and ensures good scalability. We show that our approach handles mixed workloads well and also speeds up pure OLTP workloads like TPC-C compared to existing state-of-the-art approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b4cf0ab6-9b60-4ffa-aa0a-173af18ca394Cited by top-tier papers13
- Teseo and the Analysis of Structural Dynamic GraphsDean De Leo, Peter BonczVLDB 2021 · 65 citations
- Sortledton: a universal, transactional graph data structurePer Fuchs, Jana Giceva, Domagoj MarganVLDB 2022 · 46 citations
- Caracal: Contention Management with Deterministic Concurrency ControlDai Qin, Angela Demke Brown, Ashvin GoelSOSP 2021 · 37 citations
- Motor: Enabling Multi-Versioning for Distributed Transactions on Disaggregated MemoryMing Zhang, Yu Hua, Zhijun YangOSDI 2024 · 21 citations
- Memory-Optimized Multi-Version Concurrency Control for Disk-Based Database SystemsMichael J. Freitag, Alfons Kemper, Thomas NeumannVLDB 2022 · 14 citations
Related papers
- Diva: Making MVCC Systems HTAP-FriendlyJong-Bin Kim, Jaeseon Yu, Jaechan Ahn, Sooyong Kang et al.SIGMOD 2022 · 12 citations
- One-shot Garbage Collection for In-memory OLTP through Temporality-aware Version StorageAunn Raza, Periklis Chrysogelos, Angelos-Christos G. Anadiotis, Anastasia AilamakiSIGMOD 2023 · 7 citations
- Rethink Query Optimization in HTAP DatabasesHaoze Song, Wenchao Zhou, Feifei Li, Xiang Peng et al.SIGMOD 2024 · 7 citations
- Scalable and Robust Snapshot Isolation for High-Performance Storage EnginesAdnan Alhomssi, Viktor LeisVLDB 2023 · 12 citations
- Retrofitting High Availability Mechanism to Tame Hybrid Transaction/Analytical ProcessingSijie Shen, Rong Chen, Haibo Chen, Binyu ZangOSDI 2021 · 20 citations
