Pluto: High-Performance, Memory-Efficient Distributed Graph Analytics through Advanced Mirroring
Ying-Wei Wu, Christopher J. Rossbach, Mattan Erez
摘要
Inter-host communication poses a significant performance bottleneck in distributed graph analytics due to synchronization overheads. To mitigate this, state-of-the-art systems typically employ the full mirroring technique to replicate all potentially needed remote data and adopt a bulk-synchronous parallel execution model for coarse-grained communication. While effective for reducing network traffic, these approaches substantially increase memory footprint and constrain system parallelism. This paper introduces Pluto, a memory-efficient distributed graph analytics system based on two advanced mirroring designs: static partial mirroring and a mirror-free architecture. Nonproductive data duplication is avoided to reduce memory usage, while the work migration mechanism allows communication-computation overlap for performance improvement. For homogeneous graphs, Pluto achieves up to 3.8× speedup (harmonic mean 1.75×) compared to a full mirroring baseline and delivers up to 12× speedup (harmonic mean 1.75×) over existing open-source systems. For labeled property graphs, Pluto achieves up to 2.6× speedup (harmonic mean 1.37×) and lowers the minimum host requirement to 50%–90% of the baseline.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong 等NeurIPS 2020 · 被引用 3,935 次
- Graphite: A NUMA-aware HPC System for Graph Analytics Based on a new MPI * X Parallelism ModelMohammad Hasanzadeh-Mofrad, Rami G. Melhem, Muhammad Yousuf Ahmad, Mohammad HammoudVLDB 2020 · 被引用 142 次
- Khuzdul: Efficient and Scalable Distributed Graph Pattern Mining EngineJingji Chen, Xuehai QianASPLOS 2023 · 被引用 16 次
- SympleGraph: distributed graph processing with precise loop-carried dependency guaranteeYouwei Zhuo, Jingji Chen, Qinyi Luo, Yanzhi Wang 等PLDI 2020 · 被引用 13 次
相关 Paper
- HUGE: An Efficient and Scalable Subgraph Enumeration SystemZhengyi Yang, Longbin Lai, Xuemin Lin, Kongzhang Hao 等SIGMOD 2021 · 被引用 57 次
- ParGNN: A Scalable Graph Neural Network Training Framework on multi-GPUsJunyu Gu, Shunde Li, Rongqiang Cao, Jue Wang 等DAC 2025
- Hybrid Edge Partitioner: Partitioning Large Power-Law Graphs under Memory ConstraintsRuben Mayer, Hans-Arno JacobsenSIGMOD 2021 · 被引用 29 次
- MGG: Accelerating Graph Neural Networks with Fine-Grained Intra-Kernel Communication-Computation Pipelining on Multi-GPU PlatformsYuke Wang, Boyuan Feng, Zheng Wang, Tong Geng 等OSDI 2023 · 被引用 46 次
- A Single Machine System for Querying Big Graphs with PRAMYang Liu, Wenfei Fan, Shuhao Liu, Xiaoke Zhu 等VLDB 2025
