Efficient Learned Data Compression via Dual-Stream Feature Decoupling
Huidong Ma, Xinyan Shi, Hui Sun, Xiaofei Yue, Xiaoguang Liu, Gang Wang, Wentong Cai
Abstract
While Learned Data Compression (LDC) has achieved superior compression ratios, balancing precise probability modeling with system efficiency remains challenging. Crucially, uniform single-stream architectures struggle to simultaneously capture micro-syntactic and macro-semantic features, necessitating deep serial stacking that exacerbates latency. Compounding this, heterogeneous systems are constrained by device speed mismatches, where throughput is capped by Amdahl's Law due to serial processing. To this end, we propose a Dual-Stream Multi-Scale Decoupler that disentangles local and global contexts to replace deep serial processing with shallow parallel streams, and incorporate a Hierarchical Gated Refiner for adaptive feature refinement and precise probability modeling. Furthermore, we design a Concurrent Stream-Parallel Pipeline, which overcomes systemic bottlenecks to achieve full-pipeline parallelism. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both compression ratio and throughput, while maintaining the lowest latency and memory usage. The code is available at https: //github.com/huidong-ma/FADE .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 08e2b5a2-40cd-4993-8b5b-c0c18f46914dBuilds on7
- xLSTM: Extended Long Short-Term MemoryMaximilian Beck, Korbinian Pöppel, Markus Spanring, Andreas Auer et al.NeurIPS 2024 · 703 citations
- TRACE: A Fast Transformer-based General-Purpose Lossless CompressorYu Mao, Yufei Cui, Tei-Wei Kuo, Chun Jason XueWWW 2022 · 60 citations
- Sub-Linear Memory: How to Make Performers SLiMValerii Likhosherstov, Krzysztof Marcin Choromanski, Jared Quincy Davis, Xingyou Song et al.NeurIPS 2021 · 25 citations
- Faster and Stronger Lossless Compression with Optimized Autoregressive FrameworkYu Mao, Jingzong Li, Yufei Cui, Chun Jason XueDAC 2023 · 12 citations
- Accelerating General-purpose Lossless Compression via Simple and Scalable ParameterizationYu Mao, Yufei Cui, Tei-Wei Kuo, Chun Jason XueACM MM 2022 · 8 citations
Related papers
- EDPC: Accelerating Lossless Compression via Lightweight Probability Models and Decoupled Parallel DataflowZeyi Lu, Xiaoxiao Ma, Yujun Huang, Minxiao Chen et al.ACM MM 2025 · 1 citation
- MSDZip: Universal Lossless Compression for Multi-source Data via Stepwise-parallel and Learning-based PredictionHuidong Ma, Hui Sun, Liping Yi, Yanfeng Ding et al.WWW 2025 · 9 citations
- ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive CodingDailan He, Ziming Yang, Weikun Peng, Rui Ma et al.CVPR 2022 · 363 citations
- PACE: Post-Causal Entropy Modeling for Learned LiDAR Point Cloud CompressionJiahao Zhu, Kang You, Dandan Ding, Zhan MaICML 2026
- PMKLC: Parallel Multi-Knowledge Learning-based Lossless Compression for Large-Scale Genomics DatabaseHui Sun, Yanfeng Ding, Liping Yi, Huidong Ma et al.KDD 2025
