Incrementalization of Graph Partitioning Algorithms
Wenfei Fan, Muyang Liu, Chao Tian, Ruiqi Xu, Jingren Zhou
Abstract
This paper studies incremental graph partitioning. Given a (vertex-cut or edge-cut) partition C(G) of a graph G and updates ΔG to G, it is to compute changes ΔO to C(G), yielding a partition of the updated graph such that (a) the new partition is load-balanced, (b) its cut size is minimum, and (c) the changes ΔO are also minimum. We show that this tri-criteria optimization problem is NP-complete, even when ΔG has a constant size. Worse yet, it is unbounded, i.e., there exists no algorithm that computes such ΔO with a cost that is determined only by the changes ΔG and ΔO. We approach this by proposing to incrementalize widely-used graph partitioners A into heuristically-bounded incremental algorithms AΔ. Given graph G, updates ΔG to G and a partition A(G) of G by A, AΔ computes changes ΔO to A(G) such that (1) applying ΔO to A(G) produces a new partition of the updated graph although it may not be exactly the one derived by A, (2) it retains the same bounds on balance and cut sizes as A, and (3) ΔO is decided by ΔG alone. We show that we can deduce AΔ from both vertex-cut and edge-cut partitioners A, retaining their bounds. Using real-life and synthetic data, we verify the efficiency and partition quality of our incremental partitioners.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e0a4f737-3a94-4e73-ac2b-86a914f34b14Cited by top-tier papers12
- Out-of-Core Edge Partitioning at Linear Run-TimeRuben Mayer, Kamil Orujzade, Hans-Arno JacobsenICDE 2022 · 32 citations
- Hybrid Edge Partitioner: Partitioning Large Power-Law Graphs under Memory ConstraintsRuben Mayer, Hans-Arno JacobsenSIGMOD 2021 · 29 citations
- Automating Incremental Graph Processing with Flexible MemoizationShufeng Gong, Chao Tian, Qiang Yin, Wenyuan Yu et al.VLDB 2021 · 23 citations
- Incrementalizing Graph AlgorithmsWenfei Fan, Chao Tian, Ruiqi Xu, Qiang Yin et al.SIGMOD 2021 · 19 citations
- RAGraph: A Region-Aware Framework for Geo-Distributed Graph ProcessingFeng Yao, Qian Tao, Wenyuan Yu, Yanfeng Zhang et al.VLDB 2024 · 14 citations
Related papers
- Enhancing Balanced Graph Edge Partition with Effective Local SearchZhenyu Guo, Mingyu Xiao, Yi Zhou, Dongxiang Zhang et al.AAAI 2021 · 5 citations
- Application Driven Graph PartitioningWenfei Fan, Ruochun Jin, Muyang Liu, Ping Lu et al.SIGMOD 2020 · 54 citations
- iG-kway: Incremental k-way Graph Partitioning on GPUWan-Luan Lee, Shui Jiang, Dian-Lun Lin, Che Chang et al.DAC 2025 · 10 citations
- FSM: A Fine-grained Splitting and Merging Framework for Dual-balanced Graph PartitionChengjun Liu, Zhuo Peng, Weiguo Zheng, Lei ZouVLDB 2024 · 5 citations
- Dynamic algorithms for k-center on graphsEmilio Cruciani, Sebastian Forster, Gramoz Goranci, Yasamin Nazari et al.SODA 2024 · 4 citations
