DPconv: Super-Polynomially Faster Join Ordering
Mihail Stoian, Andreas Kipf
Abstract
We revisit the join ordering problem in query optimization. The standard exact algorithm, DPccp, has a worst-case running time of ๐ (3 ๐ ). This is prohibitively expensive for large queries, which are not that uncommon anymore. We develop a new algorithmic framework based on subset convolution. DPconv achieves a superpolynomial speedup over DPccp, breaking the ๐ (3 ๐ ) time-barrier for the first time. We show that the instantiation of our framework for the ๐ถ max cost function is up to 30x faster than DPccp for large clique queries. CCS CONCEPTS โข Information systems โ Query optimization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 90dd4313-4ab2-45c7-a08f-cee064778c02Cited by top-tier papers1
Ask how each one uses itBuilds on4
- Flow-Loss: Learning Cardinality Estimates That MatterParimarjan Negi, Ryan Marcus, Andreas Kipf, Hongzi Mao et al.VLDB 2021 ยท 102 citations
- Ready to Leap (by Co-Design)? Join Order Optimisation on Quantum HardwareManuel Schรถnberger, Stefanie Scherzinger, Wolfgang MauererSIGMOD 2023 ยท 47 citations
- Efficiently Computing Join Orders with Heuristic SearchImmanuel Haffner, Jens DittrichSIGMOD 2023 ยท 8 citations
- Shaving Logs via Large Sieve Inequality: Faster Algorithms for Sparse Convolution and MoreCe Jin, Yinzhan XuSTOC 2024 ยท 1 citation
Related papers
- Optimal Algorithms for Ranked Enumeration of Answers to Full Conjunctive QueriesNikolaos Tziavelis, Deepak Ajwani, Wolfgang Gatterbauer, Mirek Riedewald et al.VLDB 2020 ยท 45 citations
- Efficient Massively Parallel Join Optimization for Large QueriesRiccardo Mancini, Srinivas Karthik, Bikash Chandra, Vasilis Mageirakos et al.SIGMOD 2022 ยท 21 citations
- Complete Join Reordering for Null-Intolerant JoinsTaiNing Wang, Yunpeng Niu, Chee-Yong ChanICDE 2023 ยท 6 citations
- Efficient Query Re-optimization with Judicious Subquery SelectionsJunyi Zhao, Huanchen Zhang, Yihan GaoSIGMOD 2023 ยท 12 citations
- Many-Core Clique Enumeration with Fast Set IntersectionsJovan Blanusa, Radu Stoica, Paolo Ienne, Kubilay AtasuVLDB 2020
