Proteus: Autonomous Adaptive Storage for Mixed Workloads
Michael Abebe, Horatiu Lazu, Khuzaima Daudjee
Abstract
Enterprises use distributed database systems to meet the demands of mixed or hybrid transaction/analytical processing (HTAP) workloads that contain both transactional (OLTP) and analytical (OLAP) requests. Distributed HTAP systems typically maintain a complete copy of data in row-oriented storage format that is well-suited for OLTP workloads and a second complete copy in column-oriented storage format optimized for OLAP workloads. Maintaining these data copies consumes significant storage space and system resources. Conversely, if a system stores data in a single format, OLTP or OLAP workload performance suffers. This paper presents Proteus, a distributed HTAP database system that adaptively and autonomously selects and changes its storage layout to optimize for mixed workloads. Proteus generates physical execution plans that utilize storage-aware operators for efficient transaction execution. Using comprehensive HTAP workloads and state-of-the-art comparison systems, we demonstrate that Proteus delivers superior HTAP performance while providing OLTP and OLAP performance on par with designs specialized for either type of workload.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cfa0b85a-c149-4df8-9e06-77e177afb7c1Cited by top-tier papers8
- SharDAG: Scaling DAG-Based Blockchains Via Adaptive ShardingFeng Cheng, Jiang Xiao, Cunyang Liu, Shijie Zhang et al.ICDE 2024 · 20 citations
- Check Out the Big Brain on BRAD: Simplifying Cloud Data Processing with Learned Automated Data MeshesTim Kraska, Tianyu Li, Samuel Madden, Markos Markakis et al.VLDB 2023 · 13 citations
- Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRADGeoffrey X. Yu, Ziniu Wu, Ferdinand Kossmann, Tianyu Li et al.VLDB 2024 · 11 citations
- Tiresias: Enabling Predictive Autonomous Storage and IndexingMichael Abebe, Horatiu Lazu, Khuzaima DaudjeeVLDB 2022 · 10 citations
- Rethink Query Optimization in HTAP DatabasesHaoze Song, Wenchao Zhou, Feifei Li, Xiang Peng et al.SIGMOD 2024 · 7 citations
Builds on8
- Qd-tree: Learning Data Layouts for Big Data AnalyticsZongheng Yang, Badrish Chandramouli, Chi Wang, Johannes Gehrke et al.SIGMOD 2020 · 87 citations
- Learning a Partitioning Advisor for Cloud DatabasesBenjamin Hilprecht, Carsten Binnig, Uwe RöhmSIGMOD 2020 · 64 citations
- Opportunities for Optimism in Contended Main-Memory Multicore TransactionsYihe Huang, William Qian, Eddie Kohler, Barbara Liskov et al.VLDB 2020 · 60 citations
- Instance-Optimized Data Layouts for Cloud Analytics WorkloadsJialin Ding, Umar Farooq Minhas, Badrish Chandramouli, Chi Wang et al.SIGMOD 2021 · 37 citations
- Automating Distributed Tiered Storage Management in Cluster ComputingHerodotos Herodotou, Elena KakoulliVLDB 2020 · 30 citations
Related papers
- PUSHtap: PIM-based In-Memory HTAP with Unified Data Storage FormatYilong Zhao, Mingyu Gao, Huanchen Zhang, Fangxin Liu et al.ASPLOS 2025 · 4 citations
- Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP SystemsZhenghao Ding, Xinyi Zhang, Chao Zhang, Yishen Sun et al.VLDB 2026 · 1 citation
- Retrofitting High Availability Mechanism to Tame Hybrid Transaction/Analytical ProcessingSijie Shen, Rong Chen, Haibo Chen, Binyu ZangOSDI 2021 · 20 citations
- HaSiS: A Hardware-assisted Single-index Store for Hybrid Transactional and Analytical ProcessingKecheng Huang, Zhaoyan Shen, Zili Shao, Feng Chen et al.FAST 2025 · 1 citation
- AQD: Online Adaptive Query Dispatcher for HTAP DatabasesYang Wu, Tongliang Li, Xuanhe Zhou, Jianying Wang et al.VLDB 2026
