Why Files If You Have a DBMS?
Lam-Duy Nguyen, Viktor Leis
Abstract
Most Database Management Systems (DBMSs) sup-port arbitrary-sized objects through the Binary Large OBjects (BLOBs) data type. Nevertheless, application developers usually store large objects in file systems and only manage the metadata and file paths through the DBMS. This combined approach has major downsides, including a lack of transactional and indexing capabilities. Two factors contribute to the rare use of database BLOBs: the inefficiency of DBMSs in such workloads and the interoperability difficulties when interacting with external programs that expect files. To address the former, we present a new BLOB allocation and logging design that exhibits lower write amplification, reduces WAL checkpointing frequency, and consumes less storage than the conventional strategies. Our approach flushes each BLOB only once and features only a single indirection layer. Moreover, using the Filesystem in Userspace framework, BLOBs can be exposed as read-only files, allowing unmodified applications to directly access database BLOBs. The experimental results show that our design outperforms both file systems and DBMSs in handling large objects.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1e5115f9-b408-4bb8-bbab-5752b5ef6828Cited by top-tier papers4
- Cloud-Native Database Systems and Unikernels: Reimagining OS Abstractions for Modern HardwareViktor Leis, Christian DietrichVLDB 2024 · 12 citations
- Predictive Translation: High-Performance Buffer Management Without the Trade-OffsMichael Zinsmeister, Lam-Duy Nguyen, Viktor Leis, Thomas NeumannSIGMOD 2026 · 3 citations
- Moving on From Group Commit: Autonomous Commit Enables High Throughput and Low Latency on NVMe SSDsLam-Duy Nguyen, Adnan Alhomssi, Tobias Ziegler, Viktor LeisSIGMOD 2025 · 3 citations
- How to Write to SSDsBohyun Lee, Tobias Ziegler, Viktor LeisVLDB 2026 · 2 citations
Builds on11
- Releasing Locks As Early As You Can: Reducing Contention of Hotspots by Violating Two-Phase LockingZhihan Guo, Kan Wu, Cong Yan, Xiangyao YuSIGMOD 2021 · 44 citations
- Low-Latency Communication for Fast DBMS Using RDMA and Shared MemoryPhilipp Fent, Alexander van Renen, Andreas Kipf, Viktor Leis et al.ICDE 2020 · 44 citations
- Rethinking Logging, Checkpoints, and Recovery for High-Performance Storage EnginesMichael Haubenschild, Caetano Sauer, Thomas Neumann, Viktor LeisSIGMOD 2020 · 43 citations
- Virtual-Memory Assisted Buffer ManagementViktor Leis, Adnan Alhomssi, Tobias Ziegler, Yannick Loeck et al.SIGMOD 2023 · 37 citations
- WineFS: a hugepage-aware file system for persistent memory that ages gracefullyRohan Kadekodi, Saurabh Kadekodi, Soujanya Ponnapalli, Harshad Shirwadkar et al.SOSP 2021 · 35 citations
Related papers
- Closing the B+-tree vs. LSM-tree Write Amplification Gap on Modern Storage Hardware with Built-in Transparent CompressionYifan Qiao, Xubin Chen, Ning Zheng, Jiangpeng Li et al.FAST 2022 · 23 citations
- Fast and Synchronous Crash Consistency with Metadata Write-Once File SystemYanqi Pan, Wen Xia, Yifeng Zhang, Xiangyu Zou et al.OSDI 2025
- FlashAlloc: Dedicating Flash Blocks By ObjectsJonghyeok Park, Soyee Choi, Gihwan Oh, Soojun Im et al.VLDB 2023 · 3 citations
- exF2FS: Transaction Support in Log-Structured FilesystemJoontaek Oh, Sion Ji, Yongjin Kim, Youjip WonFAST 2022 · 14 citations
- Revisiting the Design of LSM-tree Based OLTP Storage Engine with Persistent MemoryBaoyue Yan, Xuntao Cheng, Bo Jiang, Shibin Chen et al.VLDB 2021 · 30 citations
