Bingo: Radix-based Bias Factorization for Random Walk on Dynamic Graphs
Pinhuan Wang, Chengying Huan, Zhibin Wang, Chen Tian, Yuede Ji, Hang Liu
摘要
Random walks are a primary means for extracting information from large-scale graphs. While most real-world graphs are inherently dynamic, state-of-the-art random walk engines failed to efficiently support such a critical use case. This paper takes the initiative to build a general random walk engine for dynamically changing graphs with two key principles: (i) This system should support both low-latency streaming updates and high-throughput batched updates. (ii) This system should achieve fast sampling speed while maintaining acceptable space consumption to support dynamic graph updates. Upholding both standards, we introduce Bingo, a GPU-based random walk engine for dynamically changing graphs. First, we propose a novel radix-based bias factorization algorithm to support constant time sampling complexity while supporting fast streaming updates. Second, we present a group-adaption design to reduce space consumption dramatically. Third, we incorporate GPU-aware designs to support high-throughput batched graph updates on massively parallel platforms. Together, Bingo outperforms existing efforts across various applications, settings, and datasets, achieving up to a 271.11x speedup compared to the state-of-the-art efforts.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper23
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 被引用 19,162 次
- Random Walk Graph Neural NetworksGiannis Nikolentzos, Michalis VazirgiannisNeurIPS 2020 · 被引用 172 次
- Accelerating graph sampling for graph machine learning using GPUsAbhinav Jangda, Sandeep Polisetty, Arjun Guha, Marco SerafiniEuroSys 2021 · 被引用 79 次
- GraphWalker: An I/O-Efficient and Resource-Friendly Graph Analytic System for Fast and Scalable Random WalksRui Wang, Yongkun Li, Hong Xie, Yinlong Xu 等USENIX ATC 2020 · 被引用 64 次
- LiveGraph: A Transactional Graph Storage System with Purely Sequential Adjacency List ScansXiaowei Zhu, Marco Serafini, Xiaosong Ma, Ashraf Aboulnaga 等VLDB 2020 · 被引用 53 次
相关 Paper
- FlexiWalker: Extensible GPU Framework for Efficient Dynamic Random Walks with Runtime AdaptationSeongyeon Park, Jaeyong Song, Changmin Shin, Sukjin Kim 等EuroSys 2026
- FlowWalker: A Memory-efficient and High-performance GPU-based Dynamic Graph Random Walk FrameworkJunyi Mei, Shixuan Sun, Chao Li, Cheng Xu 等VLDB 2024 · 被引用 10 次
- TEA: A General-Purpose Temporal Graph Random Walk EngineChengying Huan, Shuaiwen Leon Song, Santosh Pandey, Hang Liu 等EuroSys 2023 · 被引用 11 次
- Space-Efficient Random Walks on Streaming GraphsSerafeim Papadias, Zoi Kaoudi, Jorge-Arnulfo Quiané-Ruiz, Volker MarklVLDB 2023 · 被引用 8 次
- LightTraffic: On Optimizing CPU-GPU Data Traffic for Efficient Large-scale Random WalksYipeng Xing, Yongkun Li, Zhiqiang Wang, Yinlong Xu 等ICDE 2023 · 被引用 3 次
