Exploiting Inter-block Entropy to Enhance the Compressibility of Blocks with Diverse Data
Jinkwon Kim, Mincheol Kang, Jeongkyu Hong, Soontae Kim
Abstract
As higher memory bandwidth is required for data-intensive environments, memory compression can be a simple but effective solution to increase memory bandwidth. However, previous intra-block compression techniques do not provide sufficient bandwidth improvement owing to the incompressibility of blocks with diverse data while previous inter-block compression techniques suffer from huge additional memory access overheads or low compression coverages. To overcome the limitations of the previous intra-and inter-block compression techniques, we leverage both the naturally observed low-entropy among blocks and the artificially generated low-entropy resulting from our optimization techniques. Based on these two low-entropies, we propose an Entropy-based Pattern Compression (EPC), which generates an inter-block pattern from the same low-entropy region in numerous blocks and then compresses these blocks by using the selected pattern. Our evaluations show that EPC achieves up to 13% (3% on average) higher speedup and 13% (4% on average) DRAM energy consumption reduction with 160x (20x on average) fewer patterns(groups) compared to the state-of-the-art inter-block compression technique.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 28b4971a-7ccc-4881-900b-dd20e293814aCited by top-tier papers2
- Memory Allocation Under Hardware CompressionMuhammad Laghari, Yuqing Liu, Gagandeep Panwar, David Bears et al.MICRO 2024 · 2 citations
- The XOR Cache: A Catalyst for CompressionZhewen Pan, Joshua San MiguelISCA 2025 · 1 citation
Related papers
- High-Ratio Compression for Machine-Generated DataJiujing Zhang, Zhitao Shen, Shiyu Yang, Lingkai Meng et al.SIGMOD 2024 · 7 citations
- GBDI: Going Beyond Base-Delta-Immediate Compression with Global BasesAlexandra Angerd, Angelos Arelakis, Vasilis Spiliopoulos, Erik Sintorn et al.HPCA 2022 · 13 citations
- Random-Access Hardware Sequence CompressionNolan Chu, Yoon Lee, Gagandeep Panwar, Xun Steve JianISCA 2026
- Reducing Bit Writes in Non-volatile Main Memory by Similarity-aware CompressionZhangyu Chen, Yu Hua, Pengfei Zuo, Yuanyuan Sun et al.DAC 2020 · 7 citations
- Ecco: Improving Memory Bandwidth and Capacity for LLMs via Entropy-Aware Cache CompressionFeng Cheng, Cong Guo, Chiyue Wei, Junyao Zhang et al.ISCA 2025 · 12 citations
