Deploying Computational Storage for HTAP DBMSs Takes More Than Just Computation Offloading
Kitaek Lee, Insoon Jo, Jaechan Ahn, Hyuk Lee, Hwang Lee, Woong Sul, Hyungsoo Jung
Abstract
Hybrid transactional/analytical processing (HTAP) would overload database systems. To alleviate performance interference between transactions and analytics, recent research pursues the potential of in-storage processing (ISP) using commodity computational storage devices (CSDs). However, in-storage query processing faces technical challenges in HTAP environments. Continuously updated data versions pose two hurdles: (1) data items keep changing, and (2) finding visible data versions incurs excessive data access in CSDs. Such access patterns dominate the cost of query processing, which may hinder the active deployment of CSDs.
This paper addresses the core issues by proposing an
a nalyt i c offloa d e ngine
(AIDE) that transforms engine-specific query execution logic into vendor-neutral computation through a canonical interface. At the core of AIDE are the canonical representation of vendor-specific data and the separate management of data locators. It enables any CSD to execute vendor-neutral operations on canonical tuples with separate indexes, regardless of host databases. To eliminate excessive data access, we prescreen the indexes before offloading; thus, host-side prescreening can obviate the need for running costly version searching in CSDs and boost analytics. We implemented our prototype for PostgreSQL and MyRocks, demonstrating that AIDE supports efficient ISP for two databases using the same FPGA logic. Evaluation results show that AIDE improves query latency up to 42× on PostgreSQL and 34× on MyRocks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext efa8dc61-063e-4504-b16f-4fadf52652a2Cited by top-tier papers2
- PUSHtap: PIM-based In-Memory HTAP with Unified Data Storage FormatYilong Zhao, Mingyu Gao, Huanchen Zhang, Fangxin Liu et al.ASPLOS 2025 · 4 citations
- HaSiS: A Hardware-assisted Single-index Store for Hybrid Transactional and Analytical ProcessingKecheng Huang, Zhaoyan Shen, Zili Shao, Feng Chen et al.FAST 2025 · 1 citation
Builds on9
- POLARDB Meets Computational Storage: Efficiently Support Analytical Workloads in Cloud-Native Relational DatabaseWei Cao, Yang Liu, Zhushi Cheng, Ning Zheng et al.FAST 2020 · 140 citations
- PinK: High-speed In-storage Key-value Store with Bounded TailsJunsu Im, Jinwook Bae, Chanwoo Chung, Arvind et al.USENIX ATC 2020 · 85 citations
- Xenic: SmartNIC-Accelerated Distributed TransactionsHenry N. Schuh, Weihao Liang, Ming Liu, Jacob Nelson et al.SOSP 2021 · 62 citations
- Near-Data Processing in Database Systems on Native Computational Storage under HTAP WorkloadsTobias Vinçon, Christian Knödler, Leonardo Solis-Vasquez, Arthur Bernhardt et al.VLDB 2022 · 34 citations
- Mainlining Databases: Supporting Fast Transactional Workloads on Universal Columnar Data File FormatsTianyu Li, Matthew Butrovich, Amadou Ngom, Wan Shen Lim et al.VLDB 2021 · 28 citations
Related papers
- UPP: Universal Predicate Pushdown to Smart StorageIpoom Jeong, Jinghan Huang, Chuxuan Hu, Dohyun Park et al.ISCA 2025 · 7 citations
- Accelerating database analytic query workloads using an associative processorHelena Caminal, Yannis Chronis, Tianshu Wu, Jignesh M. Patel et al.ISCA 2022 · 19 citations
- Rethink Query Optimization in HTAP DatabasesHaoze Song, Wenchao Zhou, Feifei Li, Xiang Peng et al.SIGMOD 2024 · 7 citations
- AQUOMAN: An Analytic-Query Offloading MachineShuotao Xu, Thomas Bourgeat, Tianhao Huang, Hojun Kim et al.MICRO 2020 · 26 citations
- Kvell+: Snapshot Isolation without SnapshotsBaptiste Lepers, Oana Balmau, Karan Gupta, Willy ZwaenepoelOSDI 2020 · 10 citations
