A Design Space Exploration and Evaluation for Main-Memory Hash Joins in Storage Class Memory
Wentao Huang, Yunhong Ji, Xuan Zhou, Bingsheng He, Kian-Lee Tan
Abstract
In this paper, we seek to perform a rigorous experimental study of main-memory hash joins in storage class memory (SCM). In particular, we perform a design space exploration in real SCM for two state-of-the-art join algorithms: partitioned hash join (PHJ) and non-partitioned hash join (NPHJ), and identify the most crucial factors to implement an SCM-friendly join. Moreover, we present a rigorous evaluation with a broad spectrum of workloads for both joins and provide an in-depth analysis for choosing the most suitable algorithm in real SCM environment. With the most extensive experimental analysis up-to-date, we maintain that although there is no one universal winner in all scenarios, PHJ is generally superior to NPHJ in real SCM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 89cb9143-8740-41b6-b34d-e15d49cb6095Cited by top-tier papers2
- Are Joins over LSM-trees Ready: Take RocksDB as an ExampleWeiping Yu, Fan Wang, Xuwei Zhang, Siqiang LuoVLDB 2025 · 2 citations
- Sorting on Byte-Addressable Storage: The Resurgence of Tree StructureYing Zheng, Kian-Lee TanVLDB 2024 · 2 citations
Builds on31
- An Empirical Guide to the Behavior and Use of Scalable Persistent MemoryJian Yang, Juno Kim, Morteza Hoseinzadeh, Joseph Izraelevitz et al.FAST 2020 · 470 citations
- Evaluating Persistent Memory Range IndexesLucas Lersch, Xiangpeng Hao, Ismail Oukid, Tianzheng Wang et al.VLDB 2020 · 97 citations
- HeMem: Scalable Tiered Memory Management for Big Data Applications and Real NVMAmanda Raybuck, Tim Stamler, Wei Zhang, Mattan Erez et al.SOSP 2021 · 93 citations
- Characterizing and Modeling Non-Volatile Memory SystemsZixuan Wang, Xiao Liu, Jian Yang, Theodore Michailidis et al.MICRO 2020 · 88 citations
- APEX: A High-Performance Learned Index on Persistent MemoryBaotong Lu, Jialin Ding, Eric Lo, Umar Farooq Minhas et al.VLDB 2022 · 73 citations
Related papers
- Design Trade-offs for a Robust Dynamic Hybrid Hash JoinShiva Jahangiri, Michael J. Carey, Johann-Christoph FreytagVLDB 2022 · 6 citations
- NOCAP: Near-Optimal Correlation-Aware Partitioning JoinsZichen Zhu, Xiao Hu, Manos AthanassoulisSIGMOD 2024 · 4 citations
- Design and Analysis of a Processing-in-DIMM Join Algorithm: A Case Study with UPMEM DIMMsChaemin Lim, Suhyun Lee, Jinwoo Choi, Jounghoo Lee et al.SIGMOD 2023 · 50 citations
- Adopting Worst-Case Optimal Joins in Relational Database SystemsMichael J. Freitag, Maximilian Bandle, Tobias Schmidt, Alfons Kemper et al.VLDB 2020 · 79 citations
- To Partition, or Not to Partition, That is the Join Question in a Real SystemMaximilian Bandle, Jana Giceva, Thomas NeumannSIGMOD 2021 · 43 citations
