Making In-Memory Learned Indexes Efficient on Disk
Jiaoyi Zhang, Kai Su, Huanchen Zhang
Abstract
Learned indexes have been demonstrated to outperform traditional ones in memory-resident scenarios. However, recent studies show that they fail to outperform B+tree when extended to disks directly. In this paper, we argue that it is feasible to create efficient disk-based learned indexes by applying a set of general transformations and optimizations to existing in-memory ones. Through theoretical analysis and controlled experiments, we propose six transformation guidelines applicable to various state-of-the-art learned index structures to fully leverage the characteristics of disk storage. Our evaluation shows that the indexes developed by applying our guidelines achieve a Pareto improvement in both throughput and space efficiency compared to the traditional B+tree and previous implementations of disk-based learned indexes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bd5f42eb-cdea-4c17-8599-7d33bf575180Cited by top-tier papers8
- Why Are Learned Indexes So Effective but Sometimes Ineffective?Qiyu Liu, Siyuan Han, Yanlin Qi, Jingshu Peng et al.VLDB 2025 · 12 citations
- DobLIX: A Dual-Objective Learned Index for Log-Structured Merge TreesAlireza Heidari, Amirhossein Ahmadi, Wei ZhangVLDB 2025 · 4 citations
- Femur: A Flexible Framework for Fast and Secure Querying from Public Key-Value StoreJiaoyi Zhang, Liqiang Peng, Mo Sha, Weiran Liu et al.SIGMOD 2025 · 4 citations
- HIRE: A Hybrid Learned Index for Robust and Efficient Performance under Mixed WorkloadsXinyi Zhang, Liang Liang, Anastasia Ailamaki, Jianliang XuSIGMOD 2026 · 2 citations
- FB+-tree: A Memory-Optimized B+-tree with Latch-Free UpdateYuan Chen, Ao Li, Wenhai Li, Lingfeng DengVLDB 2025 · 2 citations
Builds on20
- ALEX: An Updatable Adaptive Learned IndexJialin Ding, Umar Farooq Minhas, Jia Yu, Chi Wang et al.SIGMOD 2020 · 274 citations
- Benchmarking Learned IndexesRyan Marcus, Andreas Kipf, Alexander van Renen, Mihail Stoian et al.VLDB 2021 · 185 citations
- Learning Multi-Dimensional IndexesVikram Nathan, Jialin Ding, Mohammad Alizadeh, Tim KraskaSIGMOD 2020 · 180 citations
- Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed WorkloadsJialin Ding, Vikram Nathan, Mohammad Alizadeh, Tim KraskaVLDB 2021 · 178 citations
- The PGM-index: a fully-dynamic compressed learned index with provable worst-case boundsPaolo Ferragina, Giorgio VinciguerraVLDB 2020 · 178 citations
Related papers
- Updatable Learned Indexes Meet Disk-Resident DBMS - From Evaluations to Design ChoicesHai Lan, Zhifeng Bao, J. Shane Culpepper, Renata Borovica-GajicSIGMOD 2023 · 26 citations
- A Fully On-Disk Updatable Learned IndexHai Lan, Zhifeng Bao, J. Shane Culpepper, Renata Borovica-Gajic et al.ICDE 2024 · 10 citations
- DIndex: an Efficient on-Disk Learned Index for Memory-Constrained EnvironmentsJiahuan Shen, Chuzhe Tang, Haoning Lan, Ren Ren et al.ICDE 2026
- Are Updatable Learned Indexes Ready?Chaichon Wongkham, Baotong Lu, Chris Liu, Zhicong Zhong et al.VLDB 2022 · 66 citations
- LIVAK: A High-Performance In-Memory Learned Index for Variable-Length KeysZhaole Chu, Zhou Zhang, Peiquan Jin, Xiaoliang Wang et al.DAC 2024 · 1 citation
