Carbink: Fault-Tolerant Far Memory
Yang Zhou, Hassan M. G. Wassel, Sihang Liu, Jiaqi Gao, James Mickens, Minlan Yu, Chris Kennelly, Paul Turner, David E. Culler, Henry M. Levy, Amin Vahdat
Abstract
Far memory systems allow an application to transparently access local memory as well as memory belonging to remote machines. Fault tolerance is a critical property of any practical approach for far memory, since machine failures (both planned and unplanned) are endemic in datacenters. However, designing a fault tolerance scheme that is efficient with respect to both computation and storage is difficult. In this paper, we introduce Carbink, a far memory system that uses erasure-coding, remote memory compaction, one-sided RMAs, and offloadable parity calculations to achieve fast, storage-efficient fault tolerance. Compared to Hydra, a stateof-the-art fault-tolerant system for far memory, Carbink has 29% lower tail latency and 48% higher application performance, with at most 35% higher memory usage.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers24
- Hermit: Low-Latency, High-Throughput, and Transparent Remote Memory via Feedback-Directed AsynchronyYifan Qiao, Chenxi Wang, Zhenyuan Ruan, Adam Belay et al.NSDI 2023 · 50 citations
- DINOMO: An Elastic, Scalable, High-Performance Key-Value Store for Disaggregated Persistent MemorySe Kwon Lee, Soujanya Ponnapalli, Sharad Singhal, Marcos K. Aguilera et al.VLDB 2022 · 49 citations
- Partial Failure Resilient Memory Management System for (CXL-based) Distributed Shared MemoryMingxing Zhang, Teng Ma, Jinqi Hua, Zheng Liu et al.SOSP 2023 · 38 citations
- GPU-Disaggregated Serving for Deep Learning Recommendation Models at ScaleLingyun Yang, Yongchen Wang, Yinghao Yu, Qizhen Weng et al.NSDI 2025 · 22 citations
- DiLOS: Do Not Trade Compatibility for Performance in Memory DisaggregationWonsup Yoon, Jisu Ok, Jinyoung Oh, Sue Moon et al.EuroSys 2023 · 21 citations
Builds on8
- Sync HotStuff: Simple and Practical Synchronous State Machine ReplicationIttai Abraham, Dahlia Malkhi, Kartik Nayak, Ling Ren et al.S&P 2020 · 240 citations
- AIFM: High-Performance, Application-Integrated Far MemoryZhenyuan Ruan, Malte Schwarzkopf, Marcos K. Aguilera, Adam BelayOSDI 2020 · 224 citations
- Can far memory improve job throughput?Emmanuel Amaro, Christopher Branner-Augmon, Zhihong Luo, Amy Ousterhout et al.EuroSys 2020 · 163 citations
- Twine: A Unified Cluster Management System for Shared InfrastructureChunqiang Tang, Kenny Yu, Kaushik Veeraraghavan, Jonathan Kaldor et al.OSDI 2020 · 107 citations
- Beyond malloc efficiency to fleet efficiency: a hugepage-aware memory allocatorA. H. Hunter, Chris Kennelly, Paul Turner, Darryl Gove et al.OSDI 2021 · 51 citations
Related papers
- Hydra : Resilient and Highly Available Remote MemoryYoungmoon Lee, Hasan Al Maruf, Mosharaf Chowdhury, Asaf Cidon et al.FAST 2022
- Mira: A Program-Behavior-Guided Far Memory SystemZhiyuan Guo, Zijian He, Yiying ZhangSOSP 2023 · 22 citations
- Sharry: An Efficient and Sharing Far Memory SystemChen Chen, Yuhang Huang, Shuiguang Deng, Jianwei Yin et al.DAC 2024
- Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value StoresZhisheng Hu, Pengfei Zuo, Yizou Chen, Chao Wang et al.SOSP 2024 · 2 citations
- Eden: Developer-Friendly Application-Integrated Far MemoryAnil Yelam, Stewart Grant, Saarth Deshpande, Nadav Amit et al.NSDI 2025 · 2 citations
