A Single Machine System for Querying Big Graphs with PRAM
Yang Liu, Wenfei Fan, Shuhao Liu, Xiaoke Zhu, Jianxin Li
摘要
This paper develops Planar (Plug and play PRAM), a single-machine system for graph analytics by reusing existing PRAM algorithms, without the need for designing new parallel algorithms. Planar supports both out-of-core and in-memory analytics. When a graph is too big to fit into the memory of a machine, Planar adapts PRAM to limited resources by extending a fixpoint model with multi-core parallelism, using disk as memory extension. For an in-memory task, it dedicates all available CPU cores to the task, and allows parallelly scalable PRAM algorithms to retain the property, i.e. , the more cores are available, the less runtime is taken. We develop a graph partitioning and work scheduling strategy to accommodate subgraph I/O, balance memory usage and reduce runtime, beyond traditional partitioners for multi-machine systems. Using real-life graphs, we empirically verify that Planar outperforms SOTA in-memory and out-of-core systems in efficiency and scalability.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Subway: minimizing data transfer during out-of-GPU-memory graph processingAmir Hossein Nodehi Sabet, Zhijia Zhao, Rajiv GuptaEuroSys 2020 · 被引用 84 次
- Single Machine Graph Analytics on Massive Datasets Using Intel Optane DC Persistent MemoryGurbinder Gill, Roshan Dathathri, Loc Hoang, Ramesh Peri 等VLDB 2020 · 被引用 82 次
- Application Driven Graph PartitioningWenfei Fan, Ruochun Jin, Muyang Liu, Ping Lu 等SIGMOD 2020 · 被引用 54 次
- Incrementalization of Graph Partitioning AlgorithmsWenfei Fan, Muyang Liu, Chao Tian, Ruiqi Xu 等VLDB 2020 · 被引用 47 次
- Incrementalizing Graph AlgorithmsWenfei Fan, Chao Tian, Ruiqi Xu, Qiang Yin 等SIGMOD 2021 · 被引用 19 次
相关 Paper
- Sage: Parallel Semi-Asymmetric Graph Algorithms for NVRAMsLaxman Dhulipala, Charles McGuffey, Hongbo Kang, Yan Gu 等VLDB 2020
- PimPam: Efficient Graph Pattern Matching on Real Processing-in-Memory HardwareShuangyu Cai, Boyu Tian, Huanchen Zhang, Mingyu GaoSIGMOD 2024 · 被引用 18 次
- Pluto: High-Performance, Memory-Efficient Distributed Graph Analytics through Advanced MirroringYing-Wei Wu, Christopher J. Rossbach, Mattan ErezOSDI 2026
- MiniGraph: Querying Big Graphs with a Single MachineXiaoke Zhu, Yang Liu, Shuhao Liu, Wenfei FanVLDB 2023 · 被引用 12 次
- XPGraph: XPline-Friendly Persistent Memory Graph Stores for Large-Scale Evolving GraphsRui Wang, Shuibing He, Weixu Zong, Yongkun Li 等MICRO 2022 · 被引用 21 次
