Cleaning both Data Errors and Inaccurate Constraints on Numerical Sequential Data
Xiaoou Ding, Muyun Zhou, Yida Liu, Chen Wang, Hongzhi Wang, Jianmin Wang
Abstract
Numerical sequence data from intelligent devices often have quality issues. While existing data cleaning methods focus on repairing data, we address the problem of repairing both data errors and inaccurate constraints. We propose two operations for modifying inaccurate constraints: expanding and compressing their value domains. Our solution includes constraint modification functions and algorithms to prevent under-and over-fitting in data cleaning. Theoretical evaluations demonstrate its reliability and effectiveness of the proposed solution, which achieves optimal repair with the distance no greater than |Σ ′ 𝑙 | • 𝜖 𝑒 + |Σ ′ 𝑟 | • 𝜖 𝑠 from the optimal repair. Experiments on real-life and synthetic datasets show that our bND-CRepair method improves F1-score by 17.6% compared to using the original constraints and performs best in MNAD. Results show high-level performance with the combination of our bNDCRepair and the state-of-the-art CVtRepair and Clean4TSDB in sequential data tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f2bc1869-461c-478e-90ec-b23714ed46b9Builds on6
- Discovery of Approximate (and Exact) Denial ConstraintsEduardo H. M. Pena, Eduardo C. de Almeida, Felix NaumannVLDB 2020 · 79 citations
- TSDDISCOVER: Discovering Data Dependency for Time Series DataXiaoou Ding, Yingze Li, Hongzhi Wang, Chen Wang et al.ICDE 2024 · 11 citations
- User-driven Error Detection for Time Series with EventsKim-Hung Le, Paolo PapottiICDE 2020 · 10 citations
- MTSClean: Efficient Constraint-based Cleaning for Multi-Dimensional Time Series DataXiaoou Ding, Yichen Song, Hongzhi Wang, Chen Wang et al.VLDB 2024 · 9 citations
- Conditional Regression RulesRui Kang, Shaoxu Song, Chaokun WangICDE 2022 · 7 citations
Related papers
- Time Series Data Cleaning Under Expressive Constraints on Both Rows and ColumnsXiaoou Ding, Genglong Li, Hongzhi Wang, Chen Wang et al.ICDE 2024 · 7 citations
- Multivariate Time Series Cleaning under Speed ConstraintsAoqian Zhang, Zexue Wu, Yifeng Gong, Ye Yuan et al.SIGMOD 2025 · 4 citations
- The Best of Both Worlds: On Repairing Timestamps and Attribute Values for Multivariate Time SeriesJingyu Zhu, Weiwei Deng, Yu Sun, Shaoxu Song et al.SIGMOD 2025
- Cleaning Time Series under Seasonal and Trend ConstraintsZijie Chen, Aoqian Zhang, Shaoxu SongSIGMOD 2026
- On Repairing Timestamps for Regular Interval Time SeriesChenguang Fang, Shaoxu Song, Yinan MeiVLDB 2022 · 18 citations
