A Hierarchical Contraction Scheme for Querying Big Graphs
Wenfei Fan, Yuanhao Li, Muyang Liu, Can Lu
Abstract
This paper proposes a scheme for querying big graphs with a single machine. The scheme iteratively contracts regular structures into supernodes and builds a hierarchy of contracted graphs, until the one at the top fits into the memory. For each query class Q in use, supernodes carry synopses 𝑆 Q such that queries of Q are answered by using 𝑆 Q if possible, and otherwise by drilling down to the next level with decontraction of a bounded size. Moreover, we show how to adapt a variety of existing sequential (singlemachine) algorithms to the hierarchy by reusing their logic and data structures. We also provide a bounded incremental algorithm to maintain the contracted graphs in response to updates, such that its cost is determined by the sizes of changes to the input and output only. Using real-life and synthetic graphs, we experimentally verify that with a single machine, the hierarchy is able to compute exact query answers when memory is as small as 7.6% of graphs, speeds up various applications by 9.8 times on average, and is even 120.1 times faster than some parallel graph systems that use 6 machines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 29354c80-b146-4d76-b2f2-4a3368665c96Cited by top-tier papers4
- CompressGraph: Efficient Parallel Graph Analytics with Rule-Based CompressionZheng Chen, Feng Zhang, Jiawei Guan, Jidong Zhai et al.SIGMOD 2023 · 23 citations
- Improving Graph Compression for Efficient Resource-Constrained Graph AnalyticsQian Xu, Juan Yang, Feng Zhang, Zheng Chen et al.VLDB 2024 · 9 citations
- Enabling Window-Based Monotonic Graph Analytics with Reusable Transitional Results for Pattern-Consistent QueriesZheng Chen, Feng Zhang, Yang Chen, Xiaokun Fang et al.VLDB 2024 · 6 citations
- POLIGRAS: Policy-based Graph SummarizationJiyang Bai, Peixiang ZhaoVLDB 2024 · 3 citations
Builds on1
Related papers
- MiniGraph: Querying Big Graphs with a Single MachineXiaoke Zhu, Yang Liu, Shuhao Liu, Wenfei FanVLDB 2023 · 12 citations
- HUGE: An Efficient and Scalable Subgraph Enumeration SystemZhengyi Yang, Longbin Lai, Xuemin Lin, Kongzhang Hao et al.SIGMOD 2021 · 57 citations
- FRESH: Towards Efficient Graph Queries in an Outsourced GraphKai Huang, Yunqi Li, Qingqing Ye, Yao Tian et al.ICDE 2024 · 3 citations
- IDAR: Fast Supergraph Search Using DAG IntegrationHyunjoon Kim, Seunghwan Min, Kunsoo Park, Xuemin Lin et al.VLDB 2020 · 2 citations
- Banyan: A Scoped Dataflow Engine for Graph Query ServiceLi Su, Xiaoming Qin, Zichao Zhang, Rui Yang et al.VLDB 2022 · 10 citations
