Scalable Garbage Collection for In-Memory MVCC Systems
Jan Böttcher, Viktor Leis, Thomas Neumann, Alfons Kemper
摘要
To support Hybrid Transaction and Analytical Processing (HTAP), database systems generally rely on Multi-Version Concurrency Control (MVCC). While MVCC elegantly enables lightweight isolation of readers and writers, it also generates outdated tuple versions, which, eventually, have to be reclaimed. Surprisingly, we have found that in HTAP workloads, this reclamation of old versions, i.e., garbage collection, often becomes the performance bottleneck. It turns out that in the presence of long-running queries, state-of-the-art garbage collectors are too coarse-grained. As a consequence, the number of versions grows quickly slowing down the entire system. Moreover, the standard background cleaning approach makes the system vulnerable to sudden spikes in workloads. In this work, we propose a novel garbage collection (GC) approach that prunes obsolete versions eagerly. Its seamless integration into the transaction processing keeps the GC overhead minimal and ensures good scalability. We show that our approach handles mixed workloads well and also speeds up pure OLTP workloads like TPC-C compared to existing state-of-the-art approaches.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper13
- Teseo and the Analysis of Structural Dynamic GraphsDean De Leo, Peter BonczVLDB 2021 · 被引用 65 次
- Sortledton: a universal, transactional graph data structurePer Fuchs, Jana Giceva, Domagoj MarganVLDB 2022 · 被引用 46 次
- Caracal: Contention Management with Deterministic Concurrency ControlDai Qin, Angela Demke Brown, Ashvin GoelSOSP 2021 · 被引用 37 次
- Motor: Enabling Multi-Versioning for Distributed Transactions on Disaggregated MemoryMing Zhang, Yu Hua, Zhijun YangOSDI 2024 · 被引用 21 次
- Memory-Optimized Multi-Version Concurrency Control for Disk-Based Database SystemsMichael J. Freitag, Alfons Kemper, Thomas NeumannVLDB 2022 · 被引用 14 次
相关 Paper
- Diva: Making MVCC Systems HTAP-FriendlyJong-Bin Kim, Jaeseon Yu, Jaechan Ahn, Sooyong Kang 等SIGMOD 2022 · 被引用 12 次
- One-shot Garbage Collection for In-memory OLTP through Temporality-aware Version StorageAunn Raza, Periklis Chrysogelos, Angelos-Christos G. Anadiotis, Anastasia AilamakiSIGMOD 2023 · 被引用 7 次
- Rethink Query Optimization in HTAP DatabasesHaoze Song, Wenchao Zhou, Feifei Li, Xiang Peng 等SIGMOD 2024 · 被引用 7 次
- Scalable and Robust Snapshot Isolation for High-Performance Storage EnginesAdnan Alhomssi, Viktor LeisVLDB 2023 · 被引用 12 次
- Retrofitting High Availability Mechanism to Tame Hybrid Transaction/Analytical ProcessingSijie Shen, Rong Chen, Haibo Chen, Binyu ZangOSDI 2021 · 被引用 20 次
