TreeLine: An Update-In-Place Key-Value Store for Modern Storage
Geoffrey X. Yu, Markos Markakis, Andreas Kipf, Per-Åke Larson, Umar Farooq Minhas, Tim Kraska
Abstract
Many modern key-value stores, such as RocksDB, rely on logstructured merge trees (LSMs). Originally designed for spinning disks, LSMs optimize for write performance by only making sequential writes. But this optimization comes at the cost of reads: LSMs must rely on expensive compaction jobs and Bloom ltersall to maintain reasonable read performance. For NVMe SSDs, we argue that trading o read performance for write performance is no longer always needed. With enough parallelism, NVMe SSDs have comparable random and sequential access performance. This change makes update-in-place designs, which traditionally provide excellent read performance, a viable alternative to LSMs. In this paper, we close the gap between log-structured and update-in-place designs on modern SSDs with the help of new components that take advantage of data and workload patterns. Specically, we explore three key ideas: (A) record caching for efcient point operations, (B) page grouping for high-performance range scans, and (C) insert forecasting to reduce the reorganization costs of accommodating new records. We evaluate these ideas by implementing them in a prototype update-in-place key-value store called TreeLine. On YCSB, we nd that TreeLine outperforms RocksDB and LeanStore by 2.20⇥ and 2.07⇥ respectively on average across the point workloads, and by up to 10.95⇥ and 7.52⇥ overall.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7379aec2-5c7a-401d-825c-829d7a859962Cited by top-tier papers20
- Learning to Optimize LSM-trees: Towards A Reinforcement Learning based Key-Value Store for Dynamic WorkloadsDingheng Mo, Fanchao Chen, Siqiang Luo, Caihua ShanSIGMOD 2024 · 26 citations
- Oasis: An Optimal Disjoint Segmented Learned Range FilterGuanduo Chen, Meng Li, Siqiang Luo, Zhenying HeVLDB 2024 · 17 citations
- Bf-Tree: A Modern Read-Write-Optimized Concurrent Larger-Than-Memory Range IndexXiangpeng Hao, Badrish ChandramouliVLDB 2024 · 14 citations
- Check Out the Big Brain on BRAD: Simplifying Cloud Data Processing with Learned Automated Data MeshesTim Kraska, Tianyu Li, Samuel Madden, Markos Markakis et al.VLDB 2023 · 13 citations
- Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRADGeoffrey X. Yu, Ziniu Wu, Ferdinand Kossmann, Tianyu Li et al.VLDB 2024 · 11 citations
Builds on8
- ALEX: An Updatable Adaptive Learned IndexJialin Ding, Umar Farooq Minhas, Jia Yu, Chi Wang et al.SIGMOD 2020 · 274 citations
- The PGM-index: a fully-dynamic compressed learned index with provable worst-case boundsPaolo Ferragina, Giorgio VinciguerraVLDB 2020 · 178 citations
- From WiscKey to Bourbon: A Learned Index for Log-Structured Merge TreesYifan Dai, Yien Xu, Aishwarya Ganesan, Ramnatthan Alagappan et al.OSDI 2020 · 138 citations
- Chucky: A Succinct Cuckoo Filter for LSM-TreeNiv Dayan, Moshe TwittoSIGMOD 2021 · 57 citations
- Kangaroo: Caching Billions of Tiny Objects on FlashSara McAllister, Benjamin Berg, Julian Tutuncu-Macias, Juncheng Yang et al.SOSP 2021 · 38 citations
Related papers
- SplinterDB: Closing the Bandwidth Gap for NVMe Key-Value StoresAlexander Conway, Abhishek Gupta, Vijay Chidambaram, Martin Farach-Colton et al.USENIX ATC 2020 · 90 citations
- SpanDB: A Fast, Cost-Effective LSM-tree Based KV Store on Hybrid StorageHao Chen, Chaoyi Ruan, Cheng Li, Xiaosong Ma et al.FAST 2021 · 120 citations
- WipDB: A Write-in-place Key-value Store that Mimics Bucket SortXingsheng Zhao, Song Jiang, Xingbo WuICDE 2021 · 17 citations
- Autumn: A Scalable Read Optimized LSM-Tree Based Key-Value Stores with Fast Point and Range ReadsFuheng Zhao, Zach Miller, Leron Reznikov, Divyakant Agrawal et al.ICDE 2025 · 2 citations
- Disco: A Compact Index for LSM-treesWenshao Zhong, Chen Chen, Xingbo Wu, Jakob ErikssonSIGMOD 2025 · 2 citations
