Discovering Top-k Rules using Subjective and Objective Criteria
Wenfei Fan, Ziyan Han, Yaoshu Wang, Min Xie
Abstract
This paper studies two questions about rule discovery. Can we characterize the usefulness of rules using quantitative criteria? How can we discover rules using those criteria? As a testbed, we consider entity enhancing rules (REEs), which subsume common association rules and data quality rules as special cases. We characterize REEs using a bi-criteria model, with both objective measures such as support and confidence, and subjective measures for the user's needs; we learn the subjective measure and the weight vectors via active learning. Based on the bi-criteria model, we develop a top-k algorithm to discover top-ranked REEs, and an any-time algorithm for successive discovery via lazy evaluation. We parallelize these algorithms such that they guarantee to reduce runtime when more processors are used. Using real-life and synthetic datasets, we show that the algorithms are able to find top-ranked rules and speed up conventional rule-discovery methods by 134X on average.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7024fd40-f8dc-432b-967e-b2c4f06cb3f8Cited by top-tier papers6
- Splitting Tuples of Mismatched EntitiesWenfei Fan, Ziyan Han, Weilong Ren, Ding Wang et al.SIGMOD 2024 · 5 citations
- Efficient Differential Dependency DiscoveryShulei Kuang, Honghui Yang, Zijing Tan, Shuai MaVLDB 2024 · 4 citations
- Discovering Top-k Relevant and Diversified RulesWenfei Fan, Ziyan Han, Min Xie, Guangyi ZhangSIGMOD 2025 · 2 citations
- HyperBlocker: Accelerating Rule-based Blocking in Entity Resolution using GPUsXiaoke Zhu, Min Xie, Ting Deng, Qi ZhangVLDB 2025 · 2 citations
- Incremental Rule Discovery in Response to Parameter UpdatesHaoxian Chen, Wenfei Fan, Jiaye ZhengSIGMOD 2025 · 2 citations
Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Deep Entity Matching with Pre-Trained Language ModelsYuliang Li, Jinfeng Li, Yoshihiko Suhara, AnHai Doan et al.VLDB 2021 · 484 citations
- Generalized and Scalable Optimal Sparse Decision TreesJimmy Lin, Chudi Zhong, Diane Hu, Cynthia Rudin et al.ICML 2020 · 174 citations
- Deep Learning for Blocking in Entity Matching: A Design Space ExplorationSaravanan Thirumuruganathan, Han Li, Nan Tang, Mourad Ouzzani et al.VLDB 2021 · 109 citations
Related papers
- Parallel Rule Discovery from Large Datasets by SamplingWenfei Fan, Ziyan Han, Yaoshu Wang, Min XieSIGMOD 2022 · 21 citations
- Capturing More Associations by Referencing External GraphsWenfei Fan, Muyang Liu, Shuhao Liu, Chao TianVLDB 2024 · 2 citations
- Interactive Learning for Diverse Top-k SetWeicheng Wang, Raymond Chi-Wing Wong, Jinyang Li, H. V. JagadishICDE 2025 · 1 citation
- A Comprehensive Benchmark Framework for Active Learning Methods in Entity MatchingVenkata Vamsikrishna Meduri, Lucian Popa, Prithviraj Sen, Mohamed SarwatSIGMOD 2020 · 50 citations
- Towards Event Prediction in Temporal GraphsWenfei Fan, Ruochun Jin, Ping Lu, Chao Tian et al.VLDB 2022 · 19 citations
