FUSEE: A Fully Memory-Disaggregated Key-Value Store
Jiacheng Shen, Pengfei Zuo, Xuchuan Luo, Tianyi Yang, Yuxin Su, Yangfan Zhou, Michael R. Lyu
Abstract
Distributed in-memory key-value (KV) stores are embracing the disaggregated memory (DM) architecture for higher resource utilization. However, existing KV stores on DM employ a semi-disaggregated design that stores KV pairs on DM but manages metadata with monolithic metadata servers, hence still suffering from low resource efficiency on metadata servers. To address this issue, this paper proposes FUSEE, a FUlly memory-diSaggrEgated KV StorE that brings disaggregation to metadata management. FUSEE replicates metadata, i.e., the index and memory management information, on memory nodes, manages them directly on the client side, and handles complex failures under the DM architecture. To scalably replicate the index on clients, FUSEE proposes a clientcentric replication protocol that allows clients to concurrently access and modify the replicated index. To efficiently manage disaggregated memory, FUSEE adopts a two-level memory management scheme that splits the memory management duty among clients and memory nodes. Finally, to handle the metadata corruption under client failures, FUSEE leverages an embedded operation log scheme to repair metadata with low log maintenance overhead. We evaluate FUSEE with both micro and YCSB hybrid benchmarks. The experimental results show that FUSEE outperforms the state-of-the-art KV stores on DM by up to 4.5 times with less resource consumption.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers31
- SMART: A High-Performance Adaptive Radix Tree for Disaggregated MemoryXuchuan Luo, Pengfei Zuo, Jiacheng Shen, Jiazhen Gu et al.OSDI 2023 · 21 citations
- Motor: Enabling Multi-Versioning for Distributed Transactions on Disaggregated MemoryMing Zhang, Yu Hua, Zhijun YangOSDI 2024 · 21 citations
- Ditto: An Elastic and Adaptive Memory-Disaggregated Caching SystemJiacheng Shen, Pengfei Zuo, Xuchuan Luo, Yuxin Su et al.SOSP 2023 · 17 citations
- Scaling Up Memory Disaggregated Applications with SMARTFeng Ren, Mingxing Zhang, Kang Chen, Huaxia Xia et al.ASPLOS 2024 · 16 citations
- ExtMem: Enabling Application-Aware Virtual Memory Management for Data-Intensive ApplicationsSepehr Jalalian, Shaurya Patel, Milad Rezaei Hajidehi, Margo I. Seltzer et al.USENIX ATC 2024 · 12 citations
Builds on18
- A large scale analysis of hundreds of in-memory cache clusters at TwitterJuncheng Yang, Yao Yue, K. V. RashmiOSDI 2020 · 245 citations
- AIFM: High-Performance, Application-Integrated Far MemoryZhenyuan Ruan, Malte Schwarzkopf, Marcos K. Aguilera, Adam BelayOSDI 2020 · 224 citations
- Can far memory improve job throughput?Emmanuel Amaro, Christopher Branner-Augmon, Zhihong Luo, Amy Ousterhout et al.EuroSys 2020 · 163 citations
- Disaggregating Persistent Memory and Controlling Them Remotely: An Exploration of Passive Disaggregated Key-Value StoresShin-Yeh Tsai, Yizhou Shan, Yiying ZhangUSENIX ATC 2020 · 159 citations
- Rethinking software runtimes for disaggregated memoryIrina Calciu, M. Talha Imran, Ivan Puddu, Sanidhya Kashyap et al.ASPLOS 2021 · 116 citations
Related papers
- SWARM: Replicating Shared Disaggregated-Memory Data in No TimeAntoine Murat, Clément Burgelin, Athanasios Xygkis, Igor Zablotchi et al.SOSP 2024 · 2 citations
- Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value StoresZhisheng Hu, Pengfei Zuo, Yizou Chen, Chao Wang et al.SOSP 2024 · 2 citations
- DINOMO: An Elastic, Scalable, High-Performance Key-Value Store for Disaggregated Persistent MemorySe Kwon Lee, Soujanya Ponnapalli, Sharad Singhal, Marcos K. Aguilera et al.VLDB 2022 · 49 citations
- DMTree: Towards Efficient Tree Indexing on Disaggregated Memory via Compute-side Collaborative DesignGuoli Wei, Yongkun Li, Haoze Song, Tao Li et al.FAST 2026 · 1 citation
- SepHash: A Write-Optimized Hash Index On Disaggregated Memory via Separate Segment StructureXinhao Min, Kai Lu, Pengyu Liu, Jiguang Wan et al.VLDB 2024 · 9 citations
