Rule-Based Graph Cleaning with GPUs on a Single Machine
Wenchao Bai, Wenfei Fan, Shuhao Liu, Kehan Pang, Xiaoke Zhu, Jiahui Jin
Abstract
XIAOKE ZHU, Beihang University, China JIAHUI JIN* , Southeast University, China This paper studies cost-effective graph cleaning with a single machine. We adopt a rule-based method that may embed machine learning models as predicates in the rules. Graph cleaning with the rules involves rule discovery, error detection and correction. These tasks are both computation-heavy and I/O-intensive as they repeatedly invoke costly graph pattern matching, and produce a large volume of intermediate results, among other things. In light of these, no existing single-machine system is able to carry out these tasks even on nottoo-large graphs, even using GPUs. Thus we develop MiniClean, a single-machine system for cleaning large graphs. It proposes (1) a workflow that better fits a single machine by pipelining CPU, GPU and I/O operations;
(2) memory footprint reduction with bundled processing and data compression; and (3) a multi-mode parallel model for SIMD, pipelined and independent parallelism, and their scheduling to maximize CPU-GPU synergy. Using real-life graphs, we empirically verify that MiniClean outperforms the SOTA single-machine systems by at least 65.34× and multi-machine systems with 32 nodes by at least 8.09×.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 447a4ee0-c866-48ba-bc3f-b6940c625008Builds on27
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Deep Entity Matching with Pre-Trained Language ModelsYuliang Li, Jinfeng Li, Yoshihiko Suhara, AnHai Doan et al.VLDB 2021 · 484 citations
- RNNLogic: Learning Logic Rules for Reasoning on Knowledge GraphsMeng Qu, Jun-Kun Chen, Louis-Pascal A. C. Xhonneux, Yoshua Bengio et al.ICLR 2021 · 230 citations
- Single Machine Graph Analytics on Massive Datasets Using Intel Optane DC Persistent MemoryGurbinder Gill, Roshan Dathathri, Loc Hoang, Ramesh Peri et al.VLDB 2020 · 82 citations
- GPU-Accelerated Subgraph Enumeration on Partitioned GraphsWentian Guo, Yuchen Li, Mo Sha, Bingsheng He et al.SIGMOD 2020 · 71 citations
Related papers
- Making It Tractable to Catch Duplicates and Conflicts in GraphsWenfei Fan, Wenzhi Fu, Ruochun Jin, Muyang Liu et al.SIGMOD 2023 · 10 citations
- Marius: Learning Massive Graph Embeddings on a Single MachineJason Mohoney, Roger Waleffe, Henry Xu, Theodoros Rekatsinas et al.OSDI 2021 · 75 citations
- MiniGraph: Querying Big Graphs with a Single MachineXiaoke Zhu, Yang Liu, Shuhao Liu, Wenfei FanVLDB 2023 · 12 citations
- Khuzdul: Efficient and Scalable Distributed Graph Pattern Mining EngineJingji Chen, Xuehai QianASPLOS 2023 · 16 citations
- Jupiter: Pushing Speed and Scalability Limitations for Subgraph Matching on Multi-GPUsZhiheng Lin, Ke Meng, Changjie Xu, Weichen Cao et al.EuroSys 2025 · 2 citations
