Hydra : Resilient and Highly Available Remote Memory
Youngmoon Lee, Hasan Al Maruf, Mosharaf Chowdhury, Asaf Cidon, Kang G. Shin
Abstract
We present Hydra, a low-latency, low-overhead, and highly available resilience mechanism for remote memory. Hydra can access erasure-coded remote memory within a single-digit µs read/write latency, significantly improving the performance-efficiency tradeoff over the state-of-the-art -it performs similar to in-memory replication with 1.6× lower memory overhead. We also propose CodingSets, a novel coding group placement algorithm for erasure-coded data, that provides load balancing while reducing the probability of data loss under correlated failures by an order of magnitude. With Hydra, even when only 50% memory is local, unmodified memory-intensive applications achieve performance close to that of the fully in-memory case in the presence of remote failures and outperforms the state-of-the-art remote-memory solutions by up to 4.35×.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 34933ada-7184-4aa1-bad7-8c07ac962b9bCited by top-tier papers21
- TPP: Transparent Page Placement for CXL-Enabled Tiered-MemoryHasan Al Maruf, Hao Wang, Abhishek Dhanotia, Johannes Weiner et al.ASPLOS 2023 · 255 citations
- The Case for Distributed Shared-Memory Databases with RDMA-Enabled Memory DisaggregationRuihong Wang, Jianguo Wang, Stratos Idreos, M. Tamer Özsu et al.VLDB 2023 · 49 citations
- DINOMO: An Elastic, Scalable, High-Performance Key-Value Store for Disaggregated Persistent MemorySe Kwon Lee, Soujanya Ponnapalli, Sharad Singhal, Marcos K. Aguilera et al.VLDB 2022 · 49 citations
- Partial Failure Resilient Memory Management System for (CXL-based) Distributed Shared MemoryMingxing Zhang, Teng Ma, Jinqi Hua, Zheng Liu et al.SOSP 2023 · 38 citations
- DiLOS: Do Not Trade Compatibility for Performance in Memory DisaggregationWonsup Yoon, Jisu Ok, Jinyoung Oh, Sue Moon et al.EuroSys 2023 · 21 citations
Builds on5
- AIFM: High-Performance, Application-Integrated Far MemoryZhenyuan Ruan, Malte Schwarzkopf, Marcos K. Aguilera, Adam BelayOSDI 2020 · 224 citations
- Effectively Prefetching Remote Memory with LeapHasan Al Maruf, Mosharaf ChowdhuryUSENIX ATC 2020 · 186 citations
- Rethinking software runtimes for disaggregated memoryIrina Calciu, M. Talha Imran, Ivan Puddu, Sanidhya Kashyap et al.ASPLOS 2021 · 116 citations
- Understanding the Effect of Data Center Resource Disaggregation on Production DBMSsQizhen Zhang, Yifan Cai, Xinyi Chen, Sebastian Angel et al.VLDB 2020 · 64 citations
- Justitia: Software Multi-Tenancy in Hardware Kernel-Bypass NetworksYiwen Zhang, Yue Tan, Brent E. Stephens, Mosharaf ChowdhuryNSDI 2022 · 34 citations
Related papers
- Carbink: Fault-Tolerant Far MemoryYang Zhou, Hassan M. G. Wassel, Sihang Liu, Jiaqi Gao et al.OSDI 2022 · 35 citations
- Stripeless Data Placement for Erasure-Coded In-Memory StorageJian Gao, Jiwu Shu, Bin Yan, Yuhao Zhang et al.OSDI 2025
- Redy: Remote Dynamic Memory CacheQizhen Zhang, Philip A. Bernstein, Daniel S. Berger, Badrish ChandramouliVLDB 2022 · 32 citations
- Scalable and Effective Page-table and TLB management on NUMA SystemsBin Gao, Qingxuan Kang, Hao-Wei Tee, Kyle Timothy Ng Chu et al.USENIX ATC 2024 · 5 citations
- LogECMem: coupling erasure-coded in-memory key-value stores with parity loggingLiangfeng Cheng, Yuchong Hu, Zhaokang Ke, Jia Xu et al.SC 2021 · 16 citations
