NeuroSketch: Fast and Approximate Evaluation of Range Aggregate Queries with Neural Networks
Sepanta Zeighami, Cyrus Shahabi, Vatsal Sharan
Abstract
Range aggregate queries (RAQs) are an integral part of many real-world applications, where, often, fast and approximate answers for the queries are desired. Recent work has studied answering RAQs using machine learning (ML) models, where a model of the data is learned to answer the queries. However, there is no theoretical understanding of why and when the ML based approaches perform well. Furthermore, since the ML approaches model the data, they fail to capitalize on any query specific information to improve performance in practice. In this paper, we focus on modeling "queries" rather than data and train neural networks to learn the query answers. This change of focus allows us to theoretically study our ML approach to provide a distribution and query dependent error bound for neural networks when answering RAQs. We confirm our theoretical results by developing NeuroSketch, a neural network framework to answer RAQs in practice. Extensive experimental study on real-world, TPC-benchmark and synthetic datasets show that NeuroSketch answers RAQs multiple orders of magnitude faster than state-of-the-art and with better accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c3b153ee-05a9-4b36-9fe0-b3afa639d8eaCited by top-tier papers2
- Theoretical Analysis of Learned Database Operations under Distribution Shift through Distribution LearnabilitySepanta Zeighami, Cyrus ShahabiICML 2024 · 5 citations
- PairwiseHist: Fast, Accurate, and Space-Efficient Approximate Query Processing with Data CompressionAaron Hurst, Daniel E. Lucani, Qi ZhangVLDB 2024 · 5 citations
Builds on8
- Deep Unsupervised Cardinality EstimationZongheng Yang, Eric Liang, Amog Kamsetty, Chenggang Wu et al.VLDB 2020 · 206 citations
- The phase diagram of approximation rates for deep neural networksDmitry Yarotsky, Anton ZhevnerchukNeurIPS 2020 · 156 citations
- NeuroCard: One Cardinality Estimator for All TablesZongheng Yang, Amog Kamsetty, Sifei Luan, Eric Liang et al.VLDB 2021 · 138 citations
- A Unified Deep Model of Learning from both Data and Queries for Cardinality EstimationPeizhi Wu, Gao CongSIGMOD 2021 · 73 citations
- Approximate Query Processing for Data Exploration using Deep Generative ModelsSaravanan Thirumuruganathan, Shohedul Hasan, Nick Koudas, Gautam DasICDE 2020 · 54 citations
Related papers
- Meta-Sketch: A Neural Data Structure for Estimating Item Frequencies of Data StreamsYukun Cao, Yuan Feng, Xike XieAAAI 2023 · 13 citations
- Facilitating SQL Query Composition and AnalysisZainab Zolaktaf, Mostafa Milani, Rachel PottingerSIGMOD 2020 · 19 citations
- Delegation sketch: a parallel design with support for fast and accurate concurrent operationsCharalampos Stylianopoulos, Ivan Walulya, Magnus Almgren, Olaf Landsiedel et al.EuroSys 2020 · 7 citations
- RatioSketch: Towards More Accurate Frequency Estimation in Data Streams via a Lightweight Neural NetworkMengbo Wang, Zhuochen Fan, Dayu Wang, Guorui Xie et al.AAAI 2026 · 1 citation
- On Efficient Approximate Aggregate Nearest Neighbor Queries over Learned RepresentationsCarrie Wang, Sihem Amer-Yahia, Laks V. S. Lakshmanan, Reynold ChengSIGMOD 2026
