Discovery of Denial Constraints with Hardware Acceleration
Sergio Luiz Marques Filho, Eduardo Cunha de Almeida, Marco Antonio Zanata Alves
Abstract
Denial constraints (DCs) formalize integrity rules that keep data consistent across profiling and cleaning tasks. However, discovering DCs remains computationally expensive due to the exponential size of the predicate search space and the cost of maintaining large intermediate data structures. Existing software-based DC discovery algorithms rely on evidence set materialization, candidate enumeration, and minimality checks, resulting in superlinear runtime growth and unpredictable performance, which limits their scalability in practice. We present DCArray, an FPGA-based accelerator that performs DC discovery directly in hardware pipelines. DCArray encodes DC predicates as boolean patterns and evaluates them using highly parallel logical units, each operating within a single clock cycle. Boolean patterns are encoded in a hardware-friendly prefix-tree design, eliminating the need for intermediate evidence sets and reducing memory overhead and data movement. DCArray implements minimality checks at the circuit level, achieving predictable runtime independent of dataset distribution. Across real and synthetic datasets, DCArray achieves speedups of up to 1560x over DCFinder and up to 10x over ECP on 1M tuples, while efficiently utilizing HBM/PCIe. At the 10M-tuple scale, end-to-end performance is primarily limited by sustained host-device I/O bandwidth, making DCArray a practical alternative for production data-quality pipelines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cd9b355a-7dcb-46df-912b-77a58c6bda3cBuilds on9
- Discovery of Approximate (and Exact) Denial ConstraintsEduardo H. M. Pena, Eduardo C. de Almeida, Felix NaumannVLDB 2020 · 79 citations
- Approximate Denial ConstraintsEster Livshits, Alireza Heidari, Ihab F. Ilyas, Benny KimelfeldVLDB 2020 · 60 citations
- Lowering the Latency of Data Processing Pipelines Through FPGA based Hardware AccelerationMuhsen Owaida, Gustavo Alonso, Laura Fogliarini, Anthony Hock-Koon et al.VLDB 2020 · 48 citations
- CXL and the Return of Scale-Up Database EnginesAlberto Lerner, Gustavo AlonsoVLDB 2024 · 34 citations
- Fast Algorithms for Denial Constraint DiscoveryEduardo H. M. Pena, Fábio Porto, Felix NaumannVLDB 2023 · 23 citations
Related papers
- DCDiscover: Mining Threshold Denial Constraints from Time Series DataXiaoou Ding, Muyun Zhou, Yida Liu, Zekai Qian et al.ICDE 2025 · 1 citation
- Discovering Denial Constraints in Dynamic DatasetsEduardo H. M. Pena, Fábio Porto, Felix NaumannICDE 2024 · 2 citations
- Discovering Approximate Denial Constraints in Large DatabasesAlbert Martin, Eduardo C. de Almeida, Oscar Romero, Anna QueraltVLDB 2026 · 2 citations
- Rapidash: Efficient Detection of Constraint ViolationsZifan Liu, Shaleen Deep, Anna Fariha, Fotis Psallidas et al.VLDB 2024 · 1 citation
- Fast Detection of Denial Constraint ViolationsEduardo H. M. Pena, Eduardo Cunha de Almeida, Felix NaumannVLDB 2022 · 22 citations
