Towards Condensed and Efficient Read-Only File System via Sort-Enhanced Compression
Hao Huang, Yifeng Zhang, Yanqi Pan, Wen Xia, Xiangyu Zou, Darong Yang, Jubin Zhong, Hua Liao
Abstract
Read-only compressed file systems have become increasingly popular in space-sensitive scenarios, such as IoT and Docker containers. To construct condensed images, they divide the data into blocks (e.g., 1 MB) and compress blocks separately. However, we observe that block-based compression cannot fully utilize the compression benefits due to the data mixture problem, while its performance issues hinder practical usage.
We propose RubikFS 1 , a sort-enhanced read-only file system. Our key idea is to solve data mixture by sorting and clustering similar data chunks in a file system-favored block granularity. This is achieved by similarity sorter, which builds a similarity graph to measure the similarity of data chunks and clusters similar chunks by subgraph partitioning. Moreover, sorting can also group data with the same hotness to minimize read amplification. We then introduce an array of techniques, including data grouper, data chunker, and hotness grouper, to implement condensed and efficient RubikFS. Experiments suggest that, compared to existing read-only compressed file systems, RubikFS increases the compression ratio by up to 42.60% and reduces unnecessary reads by up to 70.70%.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a655b2c3-fd60-4673-a13e-9f832af4883eBuilds on17
- DupHunter: Flexible High-Performance Deduplication for Docker RegistriesNannan Zhao, Hadeel Albahar, Subil Abraham, Keren Chen et al.USENIX ATC 2020 · 54 citations
- The Dilemma between Deduplication and Locality: Can Both be Achieved?Xiangyu Zou, Jingsong Yuan, Philip Shilane, Wen Xia et al.FAST 2021 · 45 citations
- Building a High-performance Fine-grained Deduplication Framework for Backup Storage with High Deduplication RatioXiangyu Zou, Wen Xia, Philip Shilane, Haijun Zhang et al.USENIX ATC 2022 · 36 citations
- Pattern-Guided File Compression with User-Experience Enhancement for Log-Structured File System on Mobile DevicesCheng Ji, Li-Pin Chang, Riwei Pan, Chao Wu et al.FAST 2021 · 31 citations
- CacheSifter: Sifting Cache Files for Boosted Mobile Performance and LifetimeYu Liang, Riwei Pan, Tianyu Ren, Yufei Cui et al.FAST 2022 · 24 citations
Related papers
- Mitigating Resource Usage Dependency in Sorting-based KV Stores on Hybrid Storage Devices via Operation DecouplingQingyang Zhang, Yongkun Li, Yubiao Pan, Haoting Tang et al.USENIX ATC 2025 · 3 citations
- Sorting Compressed Time SeriesZhiheng Liu, Xingyu Liu, Shaoxu Song, Jianmin WangICDE 2026
- gParaKV: A GPGPU-accelerated Key-Value Separation-based KV Store with Optimized Compaction and Garbage CollectionHui Sun, Xiangxiang Jiang, Xiao Qin, Song Jiang et al.SC 2025 · 3 citations
- RubbleDB: CPU-Efficient Replication with NVMe-oFHaoyu Li, Sheng Jiang, Chen Chen, Ashwini Raina et al.USENIX ATC 2023 · 9 citations
- Optimizing Data Acquisitions in Multi-Robot SystemsYanhao Li, Zijun Xu, Xuanjun Wen, Yanjie Song et al.SC 2025 · 1 citation
