A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra
Jingwen Pan, James Cheney, Amir Shaikhha
摘要
Despite decades of research, the practical adoption of Approximate Query Processing (AQP) remains limited. Sampling-based systems such as VerdictDB often yield slow or inaccurate results for complex analytical queries, as their effectiveness depends heavily on sample quality. Model-based systems such as DeepDB perform well on simple queries but incur high runtime latency for multiway joins and group-by operations, as each group is evaluated as an independent query with instantiated attribute values, preventing global optimization across groups. Both approaches are tied to fixed hardware backends, limiting flexibility across CPU and GPU platforms. This paper presents BayesAQP, a backend-agnostic AQP framework that compiles Bayesian Network (BN) inference into tensor algebra (TA) programs. During training, BayesAQP models per-table statistics using BNs and integrates join histograms for efficient multi-table queries. At runtime, SQL queries are compiled into TA programs in BTL++, a tensor-centric probabilistic programming language, and optimized into tensor contractions for execution on tensor processing frameworks across CPUs and GPUs. Experimental results show that BayesAQP achieves an average 37× speed-up over existing AQP systems on three real-world datasets while maintaining comparable accuracy and significantly improving performance for complex multiway join and group-by queries.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Query Processing on Tensor Computation RuntimesDong He, Supun Chathuranga Nakandala, Dalitso Banda, Rathijit Sen 等VLDB 2022 · 被引用 54 次
- TQEx: Tensor-based Query Engine Enhanced by Bridging the GapHaitao Zhang, Ran Pang, Yuanyuan Zhu, Hao Zhang 等SIGMOD 2026
- Tensor processing primitives: a programming abstraction for efficiency and portability in deep learning workloadsEvangelos Georganas, Dhiraj D. Kalamkar, Sasikanth Avancha, Menachem Adelman 等SC 2021 · 被引用 2 次
- Galley: Modern Query Optimization for Sparse Tensor ProgramsKyle Deeds, Willow Ahrens, Magdalena Balazinska, Dan SuciuSIGMOD 2025 · 被引用 3 次
- TenGraph: A Tensor-Based Graph Query EngineGuanghua Li, Hao Zhang, Xibo Sun, Qiong Luo 等VLDB 2024 · 被引用 4 次
