D2FS: Device-Driven Filesystem Garbage Collection
Juwon Kim, Seungjae Lee, Joontaek Oh, Dongkun Shin, Youjip Won
Abstract
In this work, we propose a mechanism to free the logstructured filesystem from running the garbage collection. We exploit the garbage collection functionality of the underlying flash storage to reclaim the invalid sections in the filesystem partition. We call it a Log-structured Filesystem with Device-Driven Garbage Collection, D2FS. D2FS consists of three key ingredients: Coupled Garbage Collection, Migration Upcall, and Virtual Overprovisioning. Coupled Garbage Collection consolidates the valid flash pages at the storage device and remaps the migrated flash pages to new filesystem locations so that the valid pages are clustered not only physically but also logically. Migration Upcall asynchronously notifies the host about the file mappings updated by the Coupled Garbage Collection, minimizing interference with the foreground filesystem operations. Virtual Overprovisioning separates the size of the filesystem partition from the physical capacity of the associated storage partition and sets the size of the filesystem partition larger than the physical storage partition. Virtual overprovisioning ensures that FTL runs the device-level garbage collection on time so that the filesystem partition never runs out of free sections. By integrating these techniques, we save the log-structured filesystem from the garbage collection overhead, a primary obstacle hindering its widespread adoption in production environments. D2FS outperforms F2FS by 3× (FIO), zoned F2FS by 1.7× (FIO), and IPLFS by 1.5× (MySQL YCSB-F).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext df52740b-8652-4b6d-8445-b7ba4961f96dBuilds on15
- ZNS: Avoiding the Block Interface Tax for Flash-based SSDsMatias Bjørling, Abutalib Aghayev, Hans Holmberg, Aravind Ramesh et al.USENIX ATC 2021 · 221 citations
- FlatStore: An Efficient Log-Structured Key-Value Storage Engine for Persistent MemoryYoumin Chen, Youyou Lu, Fan Yang, Qing Wang et al.ASPLOS 2020 · 166 citations
- SpanDB: A Fast, Cost-Effective LSM-tree Based KV Store on Hybrid StorageHao Chen, Chaoyi Ruan, Cheng Li, Xiaosong Ma et al.FAST 2021 · 120 citations
- ZNS+: Advanced Zoned Namespace Interface for Supporting In-Storage Zone CompactionKyuhwa Han, Hyunho Gwak, Dongkun Shin, Jooyoung HwangOSDI 2021 · 107 citations
- Separating Data via Block Invalidation Time Inference for Write Amplification Reduction in Log-Structured StorageQiuping Wang, Jinhong Li, Patrick P. C. Lee, Tao Ouyang et al.FAST 2022 · 56 citations
Related papers
- IPLFS: Log-Structured File System without Garbage CollectionJuwon Kim, Minsu Kim, Muhammad Danish Tehseen, Joontaek Oh et al.USENIX ATC 2022
- GAZE: Rearchitecting Log-Structured Filesystem for Garbage Collection on Zoned Namespace Flash StorageJuwon Kim, Hwanseok Yoo, Seung Won Yoo, Youjip WonSOSP 2026
- ScaleLFS: A Log-Structured File System with Scalable Garbage Collection for Commodity SSDsJinyong Ha, Sangjin Lee, Hyeonsang Eom, Yongseok SonFAST 2025 · 7 citations
- RAIZN: Redundant Array of Independent Zoned NamespacesThomas Kim, Jekyeom Jeon, Nikhil Arora, Huaicheng Li et al.ASPLOS 2023 · 38 citations
- MIDAS: Minimizing Write Amplification in Log-Structured Systems through Adaptive Group Number and Size ConfigurationSeonggyun Oh, Jeeyun Kim, Soyoung Han, Jaeho Kim et al.FAST 2024 · 16 citations
