Splitting Tuples of Mismatched Entities
Wenfei Fan, Ziyan Han, Weilong Ren, Ding Wang, Yaoshu Wang, Min Xie, Mengyi Yan
Abstract
There has been a host of work on entity resolution (ER), to identify tuples that refer to the same entity. This paper studies the inverse of ER, to identify tuples to which distinct real-world entities are matched by mistake, and split such tuples into a set of tuples, one for each entity. We formulate the tuple splitting problem. We propose a scheme to decide what tuples to split and what tuples to correct without splitting, fix errors/assign attribute values to the split tuples, and impute missing values. The scheme introduces a class of rules, which embed predicates for aligning entities across relations and knowledge graphs G, assessing correlation between attributes, and extracting data from G. It unifies logic deduction, correlation models, and data extraction by chasing the data with the rules. We train machine learning models to assess attribute correlation and predict missing values. We develop algorithms for the tuple splitting scheme. Using real-life data, we empirically verify that the scheme is efficient and accurate, with F-measure 0.92 on average.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a87fc5c8-e194-4d36-9027-29ab29abc9feCited by top-tier papers2
- Incremental Rule Discovery in Response to Parameter UpdatesHaoxian Chen, Wenfei Fan, Jiaye ZhengSIGMOD 2025 · 2 citations
- Enriching Relations with Additional Attributes for ERMengyi Yan, Wenfei Fan, Yaoshu Wang, Min XieVLDB 2024 · 1 citation
Builds on29
- MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph EmbeddingXinyu Fu, Jiani Zhang, Ziqiao Meng, Irwin KingWWW 2020 · 1,149 citations
- Deep Entity Matching with Pre-Trained Language ModelsYuliang Li, Jinfeng Li, Yoshihiko Suhara, AnHai Doan et al.VLDB 2021 · 484 citations
- Generative Semi-supervised Learning for Multivariate Time Series ImputationXiaoye Miao, Yangyang Wu, Jun Wang, Yunjun Gao et al.AAAI 2021 · 212 citations
- Missing Data Imputation using Optimal TransportBoris Muzellec, Julie Josse, Claire Boyer, Marco CuturiICML 2020 · 179 citations
- Deep Learning for Blocking in Entity Matching: A Design Space ExplorationSaravanan Thirumuruganathan, Han Li, Nan Tang, Mourad Ouzzani et al.VLDB 2021 · 109 citations
Related papers
- Online Topic-Aware Entity Resolution Over Incomplete Data StreamsWeilong Ren, Xiang Lian, Kambiz GhazinourSIGMOD 2021 · 8 citations
- Deep and Collective Entity Resolution in ParallelTing Deng, Wenfei Fan, Ping Lu, Xiaomeng Luo et al.ICDE 2022 · 6 citations
- FlexER: Flexible Entity Resolution for Multiple IntentsBar Genossar, Roee Shraga, Avigdor GalSIGMOD 2023 · 15 citations
- Imputing Various Incomplete Attributes via Distance Likelihood MaximizationShaoxu Song, Yu SunKDD 2020 · 15 citations
- GraphER: Token-Centric Entity Resolution with Graph Convolutional Neural NetworksBing Li, Wei Wang, Yifang Sun, Linhan Zhang et al.AAAI 2020 · 48 citations
