Reinforced Approximate Exploratory Data Analysis
Shaddy Garg, Subrata Mitra, Tong Yu, Yash Gadhia, Arjun Kashettiwar
Abstract
Exploratory data analytics (EDA) is a sequential decision making process where analysts choose subsequent queries that might lead to some interesting insights based on the previous queries and corresponding results. Data processing systems often execute the queries on samples to produce results with low latency. Different downsampling strategy preserves different statistics of the data and have different magnitude of latency reductions. The optimum choice of sampling strategy often depends on the particular context of the analysis flow and the hidden intent of the analyst. In this paper, we are the first to consider the impact of sampling in interactive data exploration settings as they introduce approximation errors. We propose a Deep Reinforcement Learning (DRL) based framework which can optimize the sample selection in order to keep the analysis and insight generation flow intact. Evaluations with 3 real datasets show that our technique can preserve the original insight generation flow while improving the interaction latency, compared to baseline methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2ab9a946-9b72-477f-958d-e890779816aaCited by top-tier papers3
- Approximate Caching for Efficiently Serving Text-to-Image Diffusion ModelsShubham Agarwal, Subrata Mitra, Sarthak Chakraborty, Srikrishna Karanam et al.NSDI 2024 · 44 citations
- SEIDEN: Revisiting Query Processing in Video Database SystemsJaeho Bang, Gaurav Tarlok Kakkar, Pramod Chunduri, Subrata Mitra et al.VLDB 2023 · 24 citations
- PairwiseHist: Fast, Accurate, and Space-Efficient Approximate Query Processing with Data CompressionAaron Hurst, Daniel E. Lucani, Qi ZhangVLDB 2024 · 5 citations
Builds on6
- Conversational Contextual Bandit: Algorithm and ApplicationXiaoying Zhang, Hong Xie, Hang Li, John C. S. LuiWWW 2020 · 97 citations
- Multi-Agent Task-Oriented Dialog Policy Learning with Role-Aware Reward DecompositionRyuichi Takanobu, Runze Liang, Minlie HuangACL 2020 · 47 citations
- Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge GraphsMagdalena Kaiser, Rishiraj Saha Roy, Gerhard WeikumSIGIR 2021 · 45 citations
- Few-Shot Complex Knowledge Base Question Answering via Meta Reinforcement LearningYuncheng Hua, Yuan-Fang Li, Gholamreza Haffari, Guilin Qi et al.EMNLP 2020 · 36 citations
- Conditional Generative Model Based Predicate-Aware Query ApproximationNikhil Sheoran, Subrata Mitra, Vibhor Porwal, Siddharth Ghetia et al.AAAI 2022 · 14 citations
Related papers
- Guided Exploration of User GroupsMariia Seleznova, Behrooz Omidvar-Tehrani, Sihem Amer-Yahia, Eric SimonVLDB 2020 · 24 citations
- Guided Exploration of Data SummariesBrit Youngmann, Sihem Amer-Yahia, Aurélien PersonnazVLDB 2022 · 22 citations
- Supporting Guided Exploratory Visual Analysis on Time Series Data with Reinforcement LearningYang Shi, Bingchang Chen, Ying Chen, Zhuochen Jin et al.IEEE VIS 2023 · 8 citations
- Interactive Search with Reinforcement LearningWeicheng Wang, Victor Junqiu Wei, Min Xie, Di Jiang et al.ICDE 2025 · 1 citation
- Holistic query Approximation via RL ModelingSusan B. Davidson, Tova Milo, Kathy Razmadze, Gal ZeeviVLDB 2025
