Bingo: Radix-based Bias Factorization for Random Walk on Dynamic Graphs
Pinhuan Wang, Chengying Huan, Zhibin Wang, Chen Tian, Yuede Ji, Hang Liu
Abstract
Random walks are a primary means for extracting information from large-scale graphs. While most real-world graphs are inherently dynamic, state-of-the-art random walk engines failed to efficiently support such a critical use case. This paper takes the initiative to build a general random walk engine for dynamically changing graphs with two key principles: (i) This system should support both low-latency streaming updates and high-throughput batched updates. (ii) This system should achieve fast sampling speed while maintaining acceptable space consumption to support dynamic graph updates. Upholding both standards, we introduce Bingo, a GPU-based random walk engine for dynamically changing graphs. First, we propose a novel radix-based bias factorization algorithm to support constant time sampling complexity while supporting fast streaming updates. Second, we present a group-adaption design to reduce space consumption dramatically. Third, we incorporate GPU-aware designs to support high-throughput batched graph updates on massively parallel platforms. Together, Bingo outperforms existing efforts across various applications, settings, and datasets, achieving up to a 271.11x speedup compared to the state-of-the-art efforts.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on23
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Random Walk Graph Neural NetworksGiannis Nikolentzos, Michalis VazirgiannisNeurIPS 2020 · 172 citations
- Accelerating graph sampling for graph machine learning using GPUsAbhinav Jangda, Sandeep Polisetty, Arjun Guha, Marco SerafiniEuroSys 2021 · 79 citations
- GraphWalker: An I/O-Efficient and Resource-Friendly Graph Analytic System for Fast and Scalable Random WalksRui Wang, Yongkun Li, Hong Xie, Yinlong Xu et al.USENIX ATC 2020 · 64 citations
- LiveGraph: A Transactional Graph Storage System with Purely Sequential Adjacency List ScansXiaowei Zhu, Marco Serafini, Xiaosong Ma, Ashraf Aboulnaga et al.VLDB 2020 · 53 citations
Related papers
- FlexiWalker: Extensible GPU Framework for Efficient Dynamic Random Walks with Runtime AdaptationSeongyeon Park, Jaeyong Song, Changmin Shin, Sukjin Kim et al.EuroSys 2026
- FlowWalker: A Memory-efficient and High-performance GPU-based Dynamic Graph Random Walk FrameworkJunyi Mei, Shixuan Sun, Chao Li, Cheng Xu et al.VLDB 2024 · 10 citations
- TEA: A General-Purpose Temporal Graph Random Walk EngineChengying Huan, Shuaiwen Leon Song, Santosh Pandey, Hang Liu et al.EuroSys 2023 · 11 citations
- Space-Efficient Random Walks on Streaming GraphsSerafeim Papadias, Zoi Kaoudi, Jorge-Arnulfo Quiané-Ruiz, Volker MarklVLDB 2023 · 8 citations
- LightTraffic: On Optimizing CPU-GPU Data Traffic for Efficient Large-scale Random WalksYipeng Xing, Yongkun Li, Zhiqiang Wang, Yinlong Xu et al.ICDE 2023 · 3 citations
