PEFP: Efficient k-hop Constrained s-t Simple Path Enumeration on FPGA
Zhengmin Lai, You Peng, Shiyu Yang, Xuemin Lin, Wenjie Zhang
Abstract
Graph plays a vital role in representing entities and their relationships in a variety of fields, such as e-commerce networks, social networks and biological networks. Given two vertices s and t, one of the fundamental problems in graph databases is to investigate the relationships between s and t. A well-studied problem in such area is k-hop constrained s-t simple path enumeration. Nevertheless, all existing algorithms targeting this problem follow the DFS-based paradigm, which cannot scale up well. Moreover, using hardware devices like FPGA to accelerate graph computation has become popular. Motivated by this, in this paper, we propose the first FPGAbased algorithm PEFP to solve the problem of k-hop constrained s-t simple path enumeration efficiently. On the host side, we propose a preprocessing algorithm Pre-BFS to reduce the graph size and search space. On the FPGA side in PEFP, we propose a novel DFS-based batching technique to save on-chip memory efficiently. In addition, we also propose caching techniques to cache necessary data in BRAM, which overcome the latency bottleneck brought by the read/write operations from/to FPGA DRAM. Finally, we propose a data separation technique to enable dataflow optimization for the path verification module; hence the sub-stages in that module can be executed in parallel. Comprehensive experiments show that PEFP outperforms the state-of-the-art algorithm JOIN by more than 1 order of magnitude by average, and up to 2 orders of magnitude in terms of preprocessing time, query processing time and total time, respectively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bde78450-2f26-4c2f-acf9-928ae96f3fd3Cited by top-tier papers7
- Efficiently Answering Quality Constrained Shortest Distance Queries in Large GraphsYou Peng, Zhuo Ma, Wenjie Zhang, Xuemin Lin et al.ICDE 2023 · 12 citations
- PSPC: Efficient Parallel Shortest Path Counting on Large-Scale GraphsYou Peng, Jeffrey Xu Yu, Sibo WangICDE 2023 · 7 citations
- Finding Top-r Influential Communities under Aggregation FunctionsYou Peng, Song Bian, Rui Li, Sibo Wang et al.ICDE 2022 · 7 citations
- Hop-Constrained s-t Simple Path Enumeration on Large Dynamic GraphsJiujing Zhang, Shiyu Yang, Dian Ouyang, Fan Zhang et al.ICDE 2023 · 7 citations
- Towards Real-Time Counting Shortest Cycles on Dynamic Graphs: A Hub Labeling ApproachQingshuai Feng, You Peng, Wenjie Zhang, Ying Zhang et al.ICDE 2022 · 6 citations
Builds on1
Related papers
- Towards Generating Hop-constrained s-t Simple Path GraphsYuzheng Cai, Siyuan Liu, Weiguo Zheng, Xuemin LinSIGMOD 2023 · 9 citations
- Hop-constrained s-t Simple Path Enumeration: Towards Bridging Theory and PracticeYou Peng, Ying Zhang, Xuemin Lin, Wenjie Zhang et al.VLDB 2020 · 11 citations
- PathEnum: Towards Real-Time Hop-Constrained s-t Path EnumerationShixuan Sun, Yuhang Chen, Bingsheng He, Bryan HooiSIGMOD 2021 · 28 citations
- Batch Hop-Constrained s-t Simple Path Query Processing in Large GraphsLong Yuan, Kongzhang Hao, Xuemin Lin, Wenjie ZhangICDE 2024 · 9 citations
- Distributed Hop-Constrained s-t Simple Path Enumeration at Billion ScaleKongzhang Hao, Long Yuan, Wenjie ZhangVLDB 2022 · 25 citations
