ResTune: Resource Oriented Tuning Boosted by Meta-Learning for Cloud Databases
Xinyi Zhang, Hong Wu, Zhuo Chang, Shuowei Jin, Jian Tan, Feifei Li, Tieying Zhang, Bin Cui
Abstract
Modern database management systems (DBMS) contain tens to hundreds of critical performance tuning knobs that determine the system runtime behaviors. To reduce the total cost of ownership, cloud database providers put in drastic effort to automatically optimize the resource utilization by tuning these knobs. There are two challenges. First, the tuning system should always abide by the service level agreement (SLA) while optimizing the resource utilization, which imposes strict constrains on the tuning process. Second, the tuning time should be reasonably acceptable since time-consuming tuning is not practical for production and online troubleshooting.
In this paper, we design ResTune to automatically optimize the resource utilization without violating SLA constraints on the throughput and latency requirements. ResTune leverages the tuning experience from the history tasks and transfers the accumulated knowledge to accelerate the tuning process of the new tasks. The prior knowledge is represented from historical tuning tasks through an ensemble model. The model learns the similarity between the historical workloads and the target, which significantly reduces the tuning time by a meta-learning based approach. ResTune can efficiently handle different workloads and various hardware environments. We perform evaluations using benchmarks and real world workloads on different types of resources. The results show that, compared with the manually tuned configurations, ResTune * Xinyi Zhang and Hong Wu contribute equally to this paper.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4f95b36d-f786-4f7a-aaf8-2bcccef7f096Cited by top-tier papers38
- Facilitating Database Tuning with Hyper-Parameter Optimization: A Comprehensive Experimental EvaluationXinyi Zhang, Zhuo Chang, Yang Li, Hong Wu et al.VLDB 2022 · 88 citations
- GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian OptimizationJiale Lao, Yibo Wang, Yufei Li, Jianping Wang et al.VLDB 2024 · 76 citations
- LlamaTune: Sample-Efficient DBMS Configuration TuningKonstantinos Kanellis, Cong Ding, Brian Kroth, Andreas Müller et al.VLDB 2022 · 73 citations
- Towards Dynamic and Safe Configuration Tuning for Cloud DatabasesXinyi Zhang, Hong Wu, Yang Li, Jian Tan et al.SIGMOD 2022 · 62 citations
- HUNTER: An Online Cloud Database Hybrid Tuning System for Personalized RequirementsBaoqing Cai, Yu Liu, Ce Zhang, Guangyu Zhang et al.SIGMOD 2022 · 52 citations
Builds on3
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian OptimizationMaximilian Balandat, Brian Karrer, Daniel R. Jiang, Samuel Daulton et al.NeurIPS 2020 · 686 citations
- Black or White? How to Develop an AutoTuner for Memory-based AnalyticsMayuresh Kunjir, Shivnath BabuSIGMOD 2020 · 65 citations
- Facilitating SQL Query Composition and AnalysisZainab Zolaktaf, Mostafa Milani, Rachel PottingerSIGMOD 2020 · 19 citations
Related papers
- Explainable Database Management System Configuration Tuning through CounterfactualsXinyue Shao, Hongzhi Wang, Xiao Zhu, Tianyu Mu et al.ICDE 2024
- An Inquiry into Machine Learning-based Automatic Configuration Tuning Services on Real-World Database Management SystemsDana Van Aken, Dongsheng Yang, Sebastien Brillard, Ari Fiorino et al.VLDB 2021 · 108 citations
- AgentTune: An Agent-Based Large Language Model Framework for Database Knob TuningYiyan Li, Haoyang Li, Jing Zhang, Renata Borovica-Gajic et al.SIGMOD 2026 · 5 citations
- ESTune: Bayesian Uncertainty-Guided Early Stopping for Database Configuration TuningZhongwei Yue, Jun-Peng Zhu, Peng Cai, Xuan Zhou et al.SIGMOD 2026
- An Efficient Transfer Learning Based Configuration Adviser for Database TuningXinyi Zhang, Hong Wu, Yang Li, Zhengju Tang et al.VLDB 2024 · 25 citations
