Discovery of Denial Constraints with Hardware Acceleration
Sergio Luiz Marques Filho, Eduardo Cunha de Almeida, Marco Antonio Zanata Alves
摘要
Denial constraints (DCs) formalize integrity rules that keep data consistent across profiling and cleaning tasks. However, discovering DCs remains computationally expensive due to the exponential size of the predicate search space and the cost of maintaining large intermediate data structures. Existing software-based DC discovery algorithms rely on evidence set materialization, candidate enumeration, and minimality checks, resulting in superlinear runtime growth and unpredictable performance, which limits their scalability in practice. We present DCArray, an FPGA-based accelerator that performs DC discovery directly in hardware pipelines. DCArray encodes DC predicates as boolean patterns and evaluates them using highly parallel logical units, each operating within a single clock cycle. Boolean patterns are encoded in a hardware-friendly prefix-tree design, eliminating the need for intermediate evidence sets and reducing memory overhead and data movement. DCArray implements minimality checks at the circuit level, achieving predictable runtime independent of dataset distribution. Across real and synthetic datasets, DCArray achieves speedups of up to 1560x over DCFinder and up to 10x over ECP on 1M tuples, while efficiently utilizing HBM/PCIe. At the 10M-tuple scale, end-to-end performance is primarily limited by sustained host-device I/O bandwidth, making DCArray a practical alternative for production data-quality pipelines.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Discovery of Approximate (and Exact) Denial ConstraintsEduardo H. M. Pena, Eduardo C. de Almeida, Felix NaumannVLDB 2020 · 被引用 79 次
- Approximate Denial ConstraintsEster Livshits, Alireza Heidari, Ihab F. Ilyas, Benny KimelfeldVLDB 2020 · 被引用 60 次
- Lowering the Latency of Data Processing Pipelines Through FPGA based Hardware AccelerationMuhsen Owaida, Gustavo Alonso, Laura Fogliarini, Anthony Hock-Koon 等VLDB 2020 · 被引用 48 次
- CXL and the Return of Scale-Up Database EnginesAlberto Lerner, Gustavo AlonsoVLDB 2024 · 被引用 34 次
- Fast Algorithms for Denial Constraint DiscoveryEduardo H. M. Pena, Fábio Porto, Felix NaumannVLDB 2023 · 被引用 23 次
相关 Paper
- DCDiscover: Mining Threshold Denial Constraints from Time Series DataXiaoou Ding, Muyun Zhou, Yida Liu, Zekai Qian 等ICDE 2025 · 被引用 1 次
- Discovering Denial Constraints in Dynamic DatasetsEduardo H. M. Pena, Fábio Porto, Felix NaumannICDE 2024 · 被引用 2 次
- Discovering Approximate Denial Constraints in Large DatabasesAlbert Martin, Eduardo C. de Almeida, Oscar Romero, Anna QueraltVLDB 2026 · 被引用 2 次
- Rapidash: Efficient Detection of Constraint ViolationsZifan Liu, Shaleen Deep, Anna Fariha, Fotis Psallidas 等VLDB 2024 · 被引用 1 次
- Fast Detection of Denial Constraint ViolationsEduardo H. M. Pena, Eduardo Cunha de Almeida, Felix NaumannVLDB 2022 · 被引用 22 次
