MapperX: Adaptive Metadata Maintenance for Fast Crash Recovery of DM-Cache Based Hybrid Storage Devices
Lujia Yin, Li Wang, Yiming Zhang, Yuxing Peng
Abstract
DM-cache is a component of the device mapper of Linux kernel, which has been widely used to map SSDs and HDDs onto higher-level virtual block devices that take fast SSDs as a cache for slow HDDs to achieve high I/O performance at low monetary cost. While enjoying the benefit of persistent caching where SSDs accelerate normal I/O without affecting durability, the current design of DM-cache suffers from long crash recovery times (at the scale of hours) and low availability. This is because its metadata of dirty bits has to be asynchronously persisted for high I/O performance, which consequently causes all cached data on SSDs to be assumed dirty and to be recovered after the system is restarted.
This paper presents MapperX, a novel extension to DMcache that uses an on-disk adaptive bit-tree (ABT) to synchronously maintain the metadata of dirty bits in a hierarchical manner. Leveraging spatial locality of block writes, Map-perX achieves controlled metadata persistence overhead with fast crash recovery by adaptively adding/deleting leaves in the ABT where different levels represent the states of blocks with different granularity. We have implemented MapperX for Linux DM-cache module. Experimental results show that the MapperX based hybrid storage device outperforms the original DM-cache based hybrid device by orders of magnitude in crash recovery times while only introducing negligible metadata persistence overhead.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bb8944cb-b95c-4d57-93b4-41ed3fffe572Builds on5
- From WiscKey to Bourbon: A Learned Index for Log-Structured Merge TreesYifan Dai, Yien Xu, Aishwarya Ganesan, Ramnatthan Alagappan et al.OSDI 2020 · 138 citations
- Facebook's Tectonic Filesystem: Efficiency from ExascaleSatadru Pan, Theano Stavrinos, Yunqiao Zhang, Atul Sikaria et al.FAST 2021 · 110 citations
- Assise: Performance and Availability via Client-local NVM in a Distributed File SystemThomas E. Anderson, Marco Canini, Jongyul Kim, Dejan Kostic et al.OSDI 2020 · 71 citations
- MAPX: Controlled Data Migration in the Expansion of Decentralized Object-Based Storage SystemsLi Wang, Yiming Zhang, Jiawei Xu, Guangtao XueFAST 2020 · 29 citations
- Adaptive Learned Bloom Filter (Ada-BF): Efficient Utilization of the Classifier with Application to Real-Time Information Filtering on the WebZhenwei Dai, Anshumali ShrivastavaNeurIPS 2020 · 7 citations
Related papers
- DaxVM: Stressing the Limits of Memory as a File InterfaceChloe Alverti, Vasileios Karakostas, Nikhita Kunati, Georgios I. Goumas et al.MICRO 2022 · 9 citations
- ScaleCache: A Scalable Page Cache for Multiple Solid-State DrivesKiet Tuan Pham, Seokjoo Cho, Sangjin Lee, Lan Anh Nguyen et al.EuroSys 2024 · 10 citations
- MadFS: Per-File Virtualization for Userspace Persistent Memory FilesystemsShawn Zhong, Chenhao Ye, Guanzhou Hu, Suyan Qu et al.FAST 2023 · 27 citations
- P2CACHE: Exploring Tiered Memory for In-Kernel File Systems CachingZhen Lin, Lingfeng Xiang, Jia Rao, Hui LuUSENIX ATC 2023 · 25 citations
- Fast and Synchronous Crash Consistency with Metadata Write-Once File SystemYanqi Pan, Wen Xia, Yifeng Zhang, Xiangyu Zou et al.OSDI 2025
