Cole : Towards Practical Column-Based Learned Storage for Blockchain Systems
Ce Zhang, Cheng Xu, Haibo Hu, Jianliang Xu
Abstract
Blockchain provides a decentralized and tamper-resistant ledger for securely recording transactions across a network of untrusted nodes. While its transparency and integrity are beneficial, the substantial storage requirements for maintaining a complete transaction history present significant challenges. For example, Ethereum nodes require around 23TB of storage, with an annual growth rate of 4TB. Prior studies have employed various strategies to mitigate the storage challenges. Notably, COLE significantly reduces storage size and improves throughput by adopting a column-based design that incorporates a learned index, effectively eliminating data duplication in the storage layer. However, this approach has limitations in supporting chain reorganization during blockchain forks and state pruning to minimize storage overhead. In this paper, we propose COLE, an enhanced storage solution designed to address these limitations. COLE incorporates a novel rewind-supported in-memory tree structure for handling chain reorganization, leveraging content-defined chunking (CDC) to maintain a consistent hash digest for each block. For on-disk storage, a new two-level Merkle Hash Tree (MHT) structure, called prunable version tree, is developed to facilitate efficient state pruning. Both theoretical and empirical analyses show the effectiveness of COLE and its potential for practical application in real-world blockchain systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on24
- RapidChain: Scaling Blockchain via Full ShardingMahdi Zamani, Mahnush Movahedi, Mariana RaykovaCCS 2018 · 1,084 citations
- ALEX: An Updatable Adaptive Learned IndexJialin Ding, Umar Farooq Minhas, Jia Yu, Chi Wang et al.SIGMOD 2020 · 274 citations
- Learning Multi-Dimensional IndexesVikram Nathan, Jialin Ding, Mohammad Alizadeh, Tim KraskaSIGMOD 2020 · 180 citations
- Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed WorkloadsJialin Ding, Vikram Nathan, Mohammad Alizadeh, Tim KraskaVLDB 2021 · 178 citations
- The PGM-index: a fully-dynamic compressed learned index with provable worst-case boundsPaolo Ferragina, Giorgio VinciguerraVLDB 2020 · 178 citations
Related papers
- COLE: A Column-based Learned Storage for Blockchain SystemsCe Zhang, Cheng Xu, Haibo Hu, Jianliang XuFAST 2024 · 20 citations
- EC-Chain: Cost-Effective Storage Solution for Permissionless BlockchainsMinghui Xu, Hechuan Guo, Ye Cheng, Chunchi Liu et al.INFOCOM 2025 · 4 citations
- S-Store: A Scalable Data Store towards Permissioned Blockchain ShardingXiaodong QiINFOCOM 2022 · 35 citations
- FicusDB: Scalable Multi-Versioned Authenticated Archival StorageHongbo Zhang, Maofan Yin, Robbert van RenesseEuroSys 2026
- ChainKV: A Semantics-Aware Key-Value Store for Ethereum SystemZehao Chen, Bingzhe Li, Xiaojun Cai, Zhiping Jia et al.SIGMOD 2024 · 9 citations
