CAMAL: Optimizing LSM-trees via Active Learning
Weiping Yu, Siqiang Luo, Zihao Yu, Gao Cong
Abstract
We use machine learning to optimize LSM-tree structure, aiming to reduce the cost of processing various read/write operations. We introduce a new approach CAMAL, which boasts the following features: (1) ML-Aided : CAMAL is the first attempt to apply active learning to tune LSM-tree based key-value stores. The learning process is coupled with traditional cost models to improve the training process; (2) Decoupled Active Learning : backed by rigorous analysis, CAMAL adopts active learning paradigm based on a decoupled tuning of each parameter, which further accelerates the learning process; (3) Easy Extrapolation : CAMAL adopts an effective mechanism to incrementally update the model with the growth of the data size; (4) Dynamic Mode : CAMAL is able to tune LSM-tree online under dynamically changing workloads; (5) Significant System Improvement : By integrating CAMAL into a full system RocksDB, the system performance improves by 28% on average and up to 8x compared to a state-of-the-art RocksDB design.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Aster: Enhancing LSM-structures for Scalable Graph DatabaseDingheng Mo, Junfeng Liu, Fan Wang, Siqiang LuoSIGMOD 2025 · 10 citations
- Are Joins over LSM-trees Ready: Take RocksDB as an ExampleWeiping Yu, Fan Wang, Xuwei Zhang, Siqiang LuoVLDB 2025 · 2 citations
- ArceKV: Towards Workload-driven LSM-compactions for Key-Value Store Under Dynamic WorkloadsJunfeng Liu, Haoxuan Xie, Siqiang LuoVLDB 2026
- AXE: A Task Decomposition Approach to Learned LSM TuningAndy Huynh, Anwesha Saha, Harshal A. Chaudhari, Manos AthanassoulisVLDB 2025
- Nezha: A Key-Value Separated Distributed Store with Optimized Raft IntegrationYangyang Wang, Yucong Dong, Ziqian Cheng, Zichen XuICDE 2026
Builds on24
- An End-to-End Learning-based Cost EstimatorJi Sun, Guoliang LiVLDB 2020 · 251 citations
- Are We Ready For Learned Cardinality Estimation?Xiaoying Wang, Changbo Qu, Weiyuan Wu, Jiannan Wang et al.VLDB 2021 · 156 citations
- From WiscKey to Bourbon: A Learned Index for Log-Structured Merge TreesYifan Dai, Yien Xu, Aishwarya Ganesan, Ramnatthan Alagappan et al.OSDI 2020 · 138 citations
- An Inquiry into Machine Learning-based Automatic Configuration Tuning Services on Real-World Database Management SystemsDana Van Aken, Dongsheng Yang, Sebastien Brillard, Ari Fiorino et al.VLDB 2021 · 108 citations
- FPGA-Accelerated Compactions for LSM-based Key-Value StoreTeng Zhang, Jianying Wang, Xuntao Cheng, Hao Xu et al.FAST 2020 · 99 citations
Related papers
- Learning to Optimize LSM-trees: Towards A Reinforcement Learning based Key-Value Store for Dynamic WorkloadsDingheng Mo, Fanchao Chen, Siqiang Luo, Caihua ShanSIGMOD 2024 · 26 citations
- LeaderKV: Improving Read Performance of KV Stores via Learned Index and Decoupled KV TableYi Wang, Jianan Yuan, Shangyu Wu, Huan Liu et al.ICDE 2024 · 12 citations
- Endure: A Robust Tuning Paradigm for LSM Trees Under Workload UncertaintyAndy Huynh, Harshal A. Chaudhari, Evimaria Terzi, Manos AthanassoulisVLDB 2022 · 28 citations
- Structural Designs Meet Optimality: Exploring Optimized LSM-tree Structures in a Colossal Configuration SpaceJunfeng Liu, Fan Wang, Dingheng Mo, Siqiang LuoSIGMOD 2024 · 13 citations
- Autumn: A Scalable Read Optimized LSM-Tree Based Key-Value Stores with Fast Point and Range ReadsFuheng Zhao, Zach Miller, Leron Reznikov, Divyakant Agrawal et al.ICDE 2025 · 2 citations
