Incremental Lossless Graph Summarization
Jihoon Ko, Yunbum Kook, Kijung Shin
Abstract
Given a fully dynamic graph, represented as a stream of edge insertions and deletions, how can we obtain and incrementally update a lossless summary of its current snapshot? As large-scale graphs are prevalent, concisely representing them is inevitable for efficient storage and analysis. Lossless graph summarization is an effective graph-compression technique with many desirable properties. It aims to compactly represent the input graph as (a) a summary graph consisting of supernodes (i.e., sets of nodes) and superedges (i.e., edges between supernodes), which provide a rough description, and (b) edge corrections which fix errors induced by the rough description. While a number of batch algorithms, suited for static graphs, have been developed for rapid and compact graph summarization, they are highly inefficient in terms of time and space for dynamic graphs, which are common in practice. In this work, we propose MoSSo, the first incremental algorithm for lossless summarization of fully dynamic graphs. In response to each change in the input graph, MoSSo updates the output representation by repeatedly moving nodes among supernodes. MoSSo decides nodes to be moved and their destinations carefully but rapidly based on several novel ideas. Through extensive experiments on 10 real graphs, we show MoSSo is (a) Fast and 'any time': processing each change in near-constant time (less than 0.1 millisecond), up to 7 orders of magnitude faster than running state-of-the-art batch methods, (b) Scalable: summarizing graphs with hundreds of millions of edges, requiring sub-linear memory during the process, and (c) Effective: achieving comparable compression ratios even to state-of-the-art batch methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 680977e7-da53-4c30-8d06-bcb048492498Cited by top-tier papers16
- DEPCOMM: Graph Summarization on System Audit Logs for Attack InvestigationZhiqiang Xu, Pengcheng Fang, Changlin Liu, Xusheng Xiao et al.S&P 2022 · 88 citations
- SSumM: Sparse Summarization of Massive GraphsKyuhan Lee, Hyeonsoo Jo, Jihoon Ko, Sungsu Lim et al.KDD 2020 · 37 citations
- Featured Graph Coarsening with Similarity GuaranteesManoj Kumar, Anurag Sharma, Shashwat Saxena, Sandeep KumarICML 2023 · 34 citations
- Efficient Graph Summarization using Weighted LSH at Billion-ScaleQuinton Yong, Mahdi Hajiabadi, Venkatesh Srinivasan, Alex ThomoSIGMOD 2021 · 24 citations
- Auxo: A Scalable and Efficient Graph Stream Summarization StructureZhiguo Jiang, Hanhua Chen, Hai JinVLDB 2023 · 18 citations
Builds on1
Related papers
- SLUGGER: Lossless Hierarchical Summarization of Massive GraphsKyuhan Lee, Jihoon Ko, Kijung ShinICDE 2022 · 13 citations
- Personalized Graph Summarization: Formulation, Scalable Algorithms, and ApplicationsShinhwan Kang, Kyuhan Lee, Kijung ShinICDE 2022 · 14 citations
- Graph Summarization: Compactness Meets EfficiencyDeming Chu, Fan Zhang, Wenjie Zhang, Ying Zhang et al.SIGMOD 2024 · 8 citations
- POLIGRAS: Policy-based Graph SummarizationJiyang Bai, Peixiang ZhaoVLDB 2024 · 3 citations
- Making Graphs Compact by Lossless ContractionWenfei Fan, Yuanhao Li, Muyang Liu, Can LuSIGMOD 2021 · 14 citations
