REMIX: Efficient Range Query for LSM-trees
Wenshao Zhong, Chen Chen, Xingbo Wu, Song Jiang
Abstract
LSM-tree based key-value (KV) stores organize data in a multi-level structure for high-speed writes. Range queries on traditional LSM-trees must seek and sort-merge data from multiple table files on the fly, which is expensive and often leads to mediocre read performance. To improve range query efficiency on LSM-trees, we introduce a space-efficient KV index data structure, named REMIX, that records a globally sorted view of KV data spanning multiple table files. A range query on multiple REMIX-indexed data files can quickly locate the target key using a binary search, and retrieve subsequent keys in sorted order without key comparisons. We build RemixDB, an LSM-tree based KV-store that adopts a write-efficient compaction strategy and employs REMIXes for fast point and range queries. Experimental results show that REMIXes can substantially improve range query performance in a write-optimized LSM-tree based KV-store.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a5e612f2-b14c-414e-9b67-a9f0c0ab657cCited by top-tier papers12
- Differentiated Key-Value Storage Management for Balanced I/O PerformanceYongkun Li, Zhen Liu, Patrick P. C. Lee, Jiayu Wu et al.USENIX ATC 2021 · 79 citations
- Spooky: Granulating LSM-Tree Compactions CorrectlyNiv Dayan, Tamar Weiss, Shmuel Dashevsky, Michael Pan et al.VLDB 2022 · 57 citations
- SNARF: A Learning-Enhanced Range FilterKapil Vaidya, Tim Kraska, Subarna Chatterjee, Eric R. Knorr et al.VLDB 2022 · 39 citations
- Oasis: An Optimal Disjoint Segmented Learned Range FilterGuanduo Chen, Meng Li, Siqiang Luo, Zhenying HeVLDB 2024 · 17 citations
- GRF: A Global Range Filter for LSM-Trees with Shape EncodingHengrui Wang, Te Guo, Junzhao Yang, Huanchen ZhangSIGMOD 2024 · 15 citations
Builds on7
- A large scale analysis of hundreds of in-memory cache clusters at TwitterJuncheng Yang, Yao Yue, K. V. RashmiOSDI 2020 · 245 citations
- MatrixKV: Reducing Write Stalls and Write Amplification in LSM-tree Based KV Stores with Matrix Container in NVMTing Yao, Yiwen Zhang, Jiguang Wan, Qiu Cui et al.USENIX ATC 2020 · 186 citations
- From WiscKey to Bourbon: A Learned Index for Log-Structured Merge TreesYifan Dai, Yien Xu, Aishwarya Ganesan, Ramnatthan Alagappan et al.OSDI 2020 · 138 citations
- Rosetta: A Robust Space-Time Optimized Range Filter for Key-Value StoresSiqiang Luo, Subarna Chatterjee, Rafael Ketsetsidis, Niv Dayan et al.SIGMOD 2020 · 91 citations
- SplinterDB: Closing the Bandwidth Gap for NVMe Key-Value StoresAlexander Conway, Abhishek Gupta, Vijay Chidambaram, Martin Farach-Colton et al.USENIX ATC 2020 · 90 citations
Related papers
- Disco: A Compact Index for LSM-treesWenshao Zhong, Chen Chen, Xingbo Wu, Jakob ErikssonSIGMOD 2025 · 2 citations
- Range Cache: An Efficient Cache Component for Accelerating Range Queries on LSM - Based Key-Value StoresXiaoliang Wang, Peiquan Jin, Yongping Luo, Zhaole ChuICDE 2024 · 10 citations
- WipDB: A Write-in-place Key-value Store that Mimics Bucket SortXingsheng Zhao, Song Jiang, Xingbo WuICDE 2021 · 17 citations
- LeaderKV: Improving Read Performance of KV Stores via Learned Index and Decoupled KV TableYi Wang, Jianan Yuan, Shangyu Wu, Huan Liu et al.ICDE 2024 · 12 citations
- Enhancing LSM-Tree Key-Value Stores for Read-Modify-Writes via Key-Delta SeparationJinhong Li, Yanjing Ren, Shujie Han, Patrick P. C. LeeICDE 2024 · 6 citations
