Counting Is All You Need for Instant Tuple Discovery: Enabling Real-Time HTAP in Standalone DBMSs
Kyungmin Lim, Minseok Yoon, Kihwan Kim, Alan D. Fekete, Hyungsoo Jung
摘要
HTAP systems aim to unify operational and analytical workloads, yet real-time analytics remains constrained by the overhead of extract-transform-load (ETL) operations. Existing solutions often rely on dual-system architectures, incurring substantial resource costs and delays from data reformatting and relocation. We present TracerETL , a progressive ETL framework that enables real-time analytics in standalone DBMSs through instant tuple location discovery during transformation. At its core is Tracer , a counting-based tuple tracking mechanism that constructs a tuple trace vector using per-partition counters. This trace vector deterministically encodes each tuple's future relocation path with arrival order across transformation levels, enabling precise data access at any stage-without auxiliary indexes. We implement TracerETL in PostgreSQL and evaluate it against OLAP- and OLTP-optimized DBMSs. Experimental results show that PostgreSQL with TracerETL accelerates real-time HTAP queries by up to 127×, while efficiently handling progressive data conversion in a standalone DBMS.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Hermes: Off-the-Shelf Real-Time Transactional AnalyticsElena Milkai, Xiangyao Yu, Jignesh M. PatelVLDB 2025 · 被引用 2 次
- Rethink Query Optimization in HTAP DatabasesHaoze Song, Wenchao Zhou, Feifei Li, Xiang Peng 等SIGMOD 2024 · 被引用 7 次
- Log Replaying for Real-Time HTAP: An Adaptive Epoch-Based Two-Stage FrameworkJun-Peng Zhu, Zhiwei Ye, Peng Cai, Donghui Wang 等ICDE 2024 · 被引用 5 次
- OLxPBench: Real-time, Semantically Consistent, and Domain-specific are Essential in Benchmarking, Designing, and Implementing HTAP SystemsGuoxin Kang, Lei Wang, Wanling Gao, Fei Tang 等ICDE 2022 · 被引用 11 次
- Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP SystemsZhenghao Ding, Xinyi Zhang, Chao Zhang, Yishen Sun 等VLDB 2026 · 被引用 1 次
