ASIC-based Compression Accelerators for Storage Systems: Design, Placement, and Profiling Insights
Tao Lu, Jiapin Wang, Yelin Shan, Xiangping Zhang, Xiang Chen
Abstract
Lossless compression imposes significant computational overhead on datacenters when performed on CPUs. Hardware compression and decompression processing units (CDPUs) can alleviate this overhead, but optimal algorithm selection, microarchitectural design, and system-level placement of CDPUs are still not well understood. We present the design of an ASIC-based in-storage CDPU and provide a comprehensive end-to-end evaluation against two leading ASIC accelerators, Intel QAT 8970 and QAT 4xxx. The evaluation spans three dominant CDPU placement regimes: peripheral, on-chip, and in-storage. Our results reveal: (i) acute sensitivity of throughput and latency to CDPU placement and interconnection, (ii) strong correlation between compression efficiency and data patterns/layouts, (iii) placement-driven divergences between microbenchmark gains and real-application speedups, (iv) discrepancies between module and system-level power efficiency, and (v) scalability and multi-tenant interference issues of various CDPUs. These findings motivate a placement-aware, cross-layer rethinking of hardware (de)compression for hyperscale storage infrastructures.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c78590c6-c0a8-4c17-99da-0d6ca6edc4f2Builds on14
- Accelerometer: Understanding Acceleration Opportunities for Data Center Overheads at HyperscaleAkshitha Sriraman, Abhishek DhanotiaASPLOS 2020 · 78 citations
- Scalable Billion-point Approximate Nearest Neighbor Search Using SmartSSDsBing Tian, Haikun Liu, Zhuohui Duan, Xiaofei Liao et al.USENIX ATC 2024 · 53 citations
- Profiling Hyperscale Big Data ProcessingAbraham Gonzalez, Aasheesh Kolli, Samira Manabi Khan, Sihang Liu et al.ISCA 2023 · 30 citations
- CDPU: Co-designing Compression and Decompression Processing Units for Hyperscale SystemsSagar Karandikar, Aniruddha N. Udipi, Junsun Choi, Joonho Whangbo et al.ISCA 2023 · 26 citations
- Closing the B+-tree vs. LSM-tree Write Amplification Gap on Modern Storage Hardware with Built-in Transparent CompressionYifan Qiao, Xubin Chen, Ning Zheng, Jiangpeng Li et al.FAST 2022 · 23 citations
Related papers
- MetaZip: a high-throughput and efficient accelerator for DEFLATERuihao Gao, Xueqi Li, Yewen Li, Xun Wang et al.DAC 2022 · 9 citations
- CereSZ: Enabling and Scaling Error-bounded Lossy Compression on Cerebras CS-2Shihui Song, Yafan Huang, Peng Jiang, Xiaodong Yu et al.HPDC 2024 · 14 citations
- Efficient Lossless Compression of Scientific Floating-Point Data on CPUs and GPUsNoushin Azami, Alex Fallin, Martin BurtscherASPLOS 2025 · 18 citations
- DDS: DPU-optimized Disaggregated StorageQizhen Zhang, Philip A. Bernstein, Badrish Chandramouli, Jason Hu et al.VLDB 2024 · 12 citations
- QEI: Query Acceleration Can be Generic and Efficient in the CloudYifan Yuan, Yipeng Wang, Ren Wang, Rangeen Basu Roy Chowdhury et al.HPCA 2021 · 4 citations
