Truth Frequency: Leveraging Dependencies for Subset Repair
Haoda Li, Jiahui Chen, Yu Sun, Shaoxu Song, Haiwei Zhang, Xiaojie Yuan
Abstract
Inconsistent values are commonly encountered in real-world applications, which can negatively impact data analysis and decision-making. While existing research primarily focuses on identifying the smallest removal set to resolve inconsistencies, recent studies have shown that the minimum repairing principle is often incorrect as it ignores the signals provided by the attribute values. Some approaches use the most frequent values as guidance for the subset repair. This strategy has been criticized for its potential to inaccurately identify errors. To address these issues, we consider the dependencies between attribute values to determine a more appropriate subset repair. Our main contributions include (1) formalizing the optimal subset repair problem with attribute dependencies and analyzing its computational hardness; (2) computing the exact solution using integer linear programming; (3) developing an approximate algorithm with performance guarantees based on cliques and LP relaxation; and (4) designing a probabilistic approach with an approximation bound for efficiency. Experimental results on realworld datasets validate the effectiveness of our methods in both subset repair performance and downstream applications.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- The Computation of Optimal Subset RepairsDongjing Miao, Zhipeng Cai, Jianzhong Li, Xiangyu Gao et al.VLDB 2020 · 23 citations
- From Suspicious Errors to Valid Data: On Repairing Spatio-Temporal Data via Spatial and Temporal DependenciesWeiwei Deng, Yu Sun, Shaoxu Song, Xiaojie YuanSIGMOD 2026
- The Best of Both Worlds: On Repairing Timestamps and Attribute Values for Multivariate Time SeriesJingyu Zhu, Weiwei Deng, Yu Sun, Shaoxu Song et al.SIGMOD 2025
- The Cost of Representation by Subset RepairsYuxi Liu, Fangzhu Shen, Kushagra Ghosh, Amir Gilad et al.VLDB 2025 · 4 citations
- Imputing Various Incomplete Attributes via Distance Likelihood MaximizationShaoxu Song, Yu SunKDD 2020 · 15 citations
