Conditional Regression Rules
Rui Kang, Shaoxu Song, Chaokun Wang
Abstract
Mixed data distribution is widely observed, for example, the bird migration data consist of the observed locations of various birds in different years, varying in data distribution. Learning a single regression model over such a mixed data distribution is often ineffective, while manually segmenting the data, e.g., by bird, date or region, for learning individual models is truly labor-intensive. In this paper, we propose to automatically discover the regression models that apply conditionally to only a part of the data, namely conditional regression rules (CRRs), enlightened by the conditional functional dependencies (CFDs) that are FDs hold only in some data. Remarkably, a regression model may apply in different parts of data, e.g., the seasonal migration of birds is similar in different years. To capture the shared regression models, we investigate the inference of CRRs. An algorithm is devised to learn and discover CRRs from data, with the help of CRR inference. Extensive experiments on real-world datasets demonstrate that the discovered conditional regression rules are more effective than the regression models without conditions. In particular, with the inference of CRRs, the number of learned CRRs is significantly reduced without sacrificing rule semantics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a7077581-1307-4ed6-8b88-de3ff9f19080Cited by top-tier papers3
- MTSClean: Efficient Constraint-based Cleaning for Multi-Dimensional Time Series DataXiaoou Ding, Yichen Song, Hongzhi Wang, Chen Wang et al.VLDB 2024 · 9 citations
- UniClean: A Scalable Data Cleaning Solution for Mixed Errors based on Unified Cleaners and Optimized Cleaning WorkflowXiaoou Ding, Zekai Qian, Hongzhi Wang, Siying Chen et al.VLDB 2025 · 1 citation
- Cleaning both Data Errors and Inaccurate Constraints on Numerical Sequential DataXiaoou Ding, Muyun Zhou, Yida Liu, Chen Wang et al.VLDB 2025
Builds on1
Related papers
- Pattern Functional Dependencies for Data CleaningAbdulhakim Ali Qahtan, Nan Tang, Mourad Ouzzani, Yang Cao et al.VLDB 2020 · 42 citations
- Conditional Diffusion Models Based Conditional Independence TestingYanfeng Yang, Shuai Li, Yingjie Zhang, Zhuoran Sun et al.AAAI 2025 · 4 citations
- Causal Structure Discovery from Distributions Arising from Mixtures of DAGsBasil Saeed, Snigdha Panigrahi, Caroline UhlerICML 2020 · 29 citations
- TSDDISCOVER: Discovering Data Dependency for Time Series DataXiaoou Ding, Yingze Li, Hongzhi Wang, Chen Wang et al.ICDE 2024 · 11 citations
- Inconsistency Detection with Temporal Graph Functional DependenciesMorteza Alipour Langouri, Adam Mansfield, Fei Chiang, Yinghui WuICDE 2023 · 4 citations
