Learning a Partitioning Advisor for Cloud Databases
Benjamin Hilprecht, Carsten Binnig, Uwe Röhm
Abstract
Cloud vendors provide ready-to-use distributed DBMS solutions as a service. While the provisioning of a DBMS is usually fully automated, customers typically still have to make important design decisions which were traditionally made by the database administrator such as finding an optimal partitioning scheme for a given database schema and workload. In this paper, we introduce a new learned partitioning advisor based on Deep Reinforcement Learning (DRL) for OLAP-style workloads. The main idea is that a DRL agent learns the cost tradeoffs of different partitioning schemes and can thus automate the partitioning decision. In the evaluation, we show that our advisor is able to find non-trivial partitionings for a wide range of workloads and outperforms more classical approaches for automated partitioning design.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 99f739ca-a2a9-47f2-a2a6-2713660b122dCited by top-tier papers23
- Balsa: Learning a Query Optimizer Without Expert DemonstrationsZongheng Yang, Wei-Lin Chiang, Sifei Luan, Gautam Mittal et al.SIGMOD 2022 · 99 citations
- Zero-Shot Cost Models for Out-of-the-box Learned Cost PredictionBenjamin Hilprecht, Carsten BinnigVLDB 2022 · 90 citations
- DB-BERT: A Database Tuning Tool that "Reads the Manual"Immanuel TrummerSIGMOD 2022 · 71 citations
- UDO: Universal Database Optimization using Reinforcement LearningJunxiong Wang, Immanuel Trummer, Debabrota BasuVLDB 2021 · 53 citations
- Instance-Optimized Data Layouts for Cloud Analytics WorkloadsJialin Ding, Umar Farooq Minhas, Badrish Chandramouli, Chi Wang et al.SIGMOD 2021 · 37 citations
Builds on2
Related papers
- Hyper: Hybrid Physical Design Advisor with Multi-agent Reinforcement LearningZhicheng Pan, Yuanjia Zhang, Chengcheng Yang, Ahmad Ghazal et al.ICDE 2025 · 3 citations
- Grep: A Graph Learning Based Database Partitioning SystemXuanhe Zhou, Guoliang Li, Jianhua Feng, Luyang Liu et al.SIGMOD 2023 · 14 citations
- Adaptive Partitioning for Large-Scale Graph Analytics in Geo-Distributed Data CentersAmelie Chi Zhou, Juanyun Luo, Ruibo Qiu, Haobin Tan et al.ICDE 2022 · 8 citations
- DBA bandits: Self-driving index tuning under ad-hoc, analytical workloads with safety guaranteesR. Malinga Perera, Bastian Oetomo, Benjamin I. P. Rubinstein, Renata Borovica-GajicICDE 2021 · 40 citations
- LSched: A Workload-Aware Learned Query Scheduler for Analytical Database SystemsIbrahim Sabek, Tenzin Samten Ukyab, Tim KraskaSIGMOD 2022 · 25 citations
