A Single Machine System for Querying Big Graphs with PRAM
Yang Liu, Wenfei Fan, Shuhao Liu, Xiaoke Zhu, Jianxin Li
Abstract
This paper develops Planar (Plug and play PRAM), a single-machine system for graph analytics by reusing existing PRAM algorithms, without the need for designing new parallel algorithms. Planar supports both out-of-core and in-memory analytics. When a graph is too big to fit into the memory of a machine, Planar adapts PRAM to limited resources by extending a fixpoint model with multi-core parallelism, using disk as memory extension. For an in-memory task, it dedicates all available CPU cores to the task, and allows parallelly scalable PRAM algorithms to retain the property, i.e. , the more cores are available, the less runtime is taken. We develop a graph partitioning and work scheduling strategy to accommodate subgraph I/O, balance memory usage and reduce runtime, beyond traditional partitioners for multi-machine systems. Using real-life graphs, we empirically verify that Planar outperforms SOTA in-memory and out-of-core systems in efficiency and scalability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 98b8fe89-667b-467b-9cf5-2ec0141d3b6bBuilds on9
- Subway: minimizing data transfer during out-of-GPU-memory graph processingAmir Hossein Nodehi Sabet, Zhijia Zhao, Rajiv GuptaEuroSys 2020 · 84 citations
- Single Machine Graph Analytics on Massive Datasets Using Intel Optane DC Persistent MemoryGurbinder Gill, Roshan Dathathri, Loc Hoang, Ramesh Peri et al.VLDB 2020 · 82 citations
- Application Driven Graph PartitioningWenfei Fan, Ruochun Jin, Muyang Liu, Ping Lu et al.SIGMOD 2020 · 54 citations
- Incrementalization of Graph Partitioning AlgorithmsWenfei Fan, Muyang Liu, Chao Tian, Ruiqi Xu et al.VLDB 2020 · 47 citations
- Incrementalizing Graph AlgorithmsWenfei Fan, Chao Tian, Ruiqi Xu, Qiang Yin et al.SIGMOD 2021 · 19 citations
Related papers
- Sage: Parallel Semi-Asymmetric Graph Algorithms for NVRAMsLaxman Dhulipala, Charles McGuffey, Hongbo Kang, Yan Gu et al.VLDB 2020
- PimPam: Efficient Graph Pattern Matching on Real Processing-in-Memory HardwareShuangyu Cai, Boyu Tian, Huanchen Zhang, Mingyu GaoSIGMOD 2024 · 18 citations
- Pluto: High-Performance, Memory-Efficient Distributed Graph Analytics through Advanced MirroringYing-Wei Wu, Christopher J. Rossbach, Mattan ErezOSDI 2026
- MiniGraph: Querying Big Graphs with a Single MachineXiaoke Zhu, Yang Liu, Shuhao Liu, Wenfei FanVLDB 2023 · 12 citations
- XPGraph: XPline-Friendly Persistent Memory Graph Stores for Large-Scale Evolving GraphsRui Wang, Shuibing He, Weixu Zong, Yongkun Li et al.MICRO 2022 · 21 citations
