Doux: Decoupling Values from Keys for Real-Time Analytics
Shiming Yang, Yu Luo, Shuang Liu, Wei Lu, Kuien Liu, Yuxing Chen, Anqun Pan, Lixiong Zheng, Xiaoyong Du
Abstract
The Log-Structured Merge-tree (LSM-tree), widely adopted in real-time analytics systems, provides highperformance key-based operations such as point lookups and data ingestion, but suffers from poor efficiency on value-based queries, particularly range queries over secondary attributes. In this work, we propose Doux, a dual-tree storage architecture that combines a Key-Ordered Tree (KO-tree) and a Value-Ordered Tree (VO-tree) to accelerate value-range queries while preserving the high ingestion throughput and efficient key-based lookups of traditional LSM-trees. To further reduce maintenance overheads, Doux introduces two optimizations: a decoupled compaction mechanism that mitigates write amplification on the KO-tree, and DropMap, a compact auxiliary structure that reduces read amplification. Extensive experiments demonstrate that Doux significantly outperforms state-of-the-art LSM-tree baselines, achieving 5.04× average speedup on value-range queries, 2.86× faster average real-time ingestion in write-intensive workloads, and 2.51× faster average point lookups in read-intensive workloads.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get c0cc06db-3a73-483b-8916-1ab79a4502deRelated papers
- Rangereduce: Query-Driven LSM CompactionsShubham Kaushik, Manos Athanassoulis, Subhadeep SarkarICDE 2026
- DobLIX: A Dual-Objective Learned Index for Log-Structured Merge TreesAlireza Heidari, Amirhossein Ahmadi, Wei ZhangVLDB 2025 · 4 citations
- Constructing and Analyzing the LSM Compaction Design SpaceSubhadeep Sarkar, Dimitris Staratzis, Zichen Zhu, Manos AthanassoulisVLDB 2021 · 73 citations
- Disco: A Compact Index for LSM-treesWenshao Zhong, Chen Chen, Xingbo Wu, Jakob ErikssonSIGMOD 2025 · 2 citations
- Lethe: A Tunable Delete-Aware LSM EngineSubhadeep Sarkar, Tarikul Islam Papon, Dimitris Staratzis, Manos AthanassoulisSIGMOD 2020 · 68 citations
