R2O: A Dual-Layer Framework for Joint Rewriting and Ordering in Distributed Property Graph Query Optimization
Min Shi, Peng Peng, Xin Xiao, Lei Zou, Kenli Li, Xu Zhou
摘要
In distributed property graph systems, complex pattern queries are typically decomposed into subqueries that can be independently executed within individual partitions. However, the integration of their results requires inter-partition joins, which incur significant communication overhead. Moreover, the order of inter-partition joins plays a pivotal role in determining the size of intermediate results, which subsequently affects the overall efficiency of distributed query processing. To address these challenges, we propose R2O (Rewriting to Ordering), a dual-layer framework that jointly optimizes both inter-partition joins and join order for distributed pattern queries. We first introduce a partition-aware query rewriting strategy, which restructures and merges subqueries at partition boundaries to reduce intermediate results during inter-partition joins. Building on this strategy, R2O employs graph neural networks and reinforcement learning to construct a local rewriting model and a global ordering model. This unified end-to-end model effectively reduces intermediate results during inter-partition joins and identifies effective join orders, enabling efficient distributed query plan optimization. Experimental results on billion-scale property graphs indicate that R2O is compatible with different partitioning methods and yields 1–2 orders of magnitude speedup (up to 3 orders in some queries) over state-of-the-art query optimization techniques.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Connectivity-Oriented Property Graph Partitioning for Distributed Graph Pattern Query ProcessingMin Shi, Peng Peng, Xu Zhou, Jiayu Liu 等SIGMOD 2025 · 被引用 3 次
- Adaptive Partitioning for Large-Scale Graph Analytics in Geo-Distributed Data CentersAmelie Chi Zhou, Juanyun Luo, Ruibo Qiu, Haobin Tan 等ICDE 2022 · 被引用 8 次
- Grep: A Graph Learning Based Database Partitioning SystemXuanhe Zhou, Guoliang Li, Jianhua Feng, Luyang Liu 等SIGMOD 2023 · 被引用 14 次
- APEX: Adaptive Variable-Wise Parallel Execution for Worst-Case Optimal Joins on Graph QueriesYipeng Liu, Yuming Lin, Zhicheng Pan, Chengcheng Yang 等ICDE 2026
- Towards a Converged Relational-Graph Optimization FrameworkYunkai Lou, Longbin Lai, Bingqing Lyu, Yufan Yang 等SIGMOD 2025 · 被引用 4 次
