PILC: Practical Image Lossless Compression with an End-to-end GPU Oriented Neural Framework
Ning Kang, Shanzhao Qiu, Shifeng Zhang, Zhenguo Li, Shutao Xia
Abstract
Generative model based image lossless compression algorithms have seen a great success in improving compression ratio. However, the throughput for most of them is less than 1 MB/s even with the most advanced AI accelerated chips, preventing them from most real-world applications, which often require 100 MB/s. In this paper, we propose PILC, an end-to-end image lossless compression framework that achieves 200 MB/s for both compression and decom-pression with a single NVIDIA Tesla V100 GPU, 10× faster than the most efficient one before. To obtain this result, we first develop an AI codec that combines auto-regressive model and VQ-VAE which performs well in lightweight setting, then we design a low complexity entropy coder that works well with our codec. Experiments show that our framework compresses better than PNG by a margin of 30% in multiple datasets. We believe this is an important step to bring AI compression forward to commercial use.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d8d4c98a-4e76-468c-b893-0c030cb95bfcCited by top-tier papers4
- Finite-State Autoregressive Entropy Coding for Efficient Learned Lossless CompressionYufeng Zhang, Hang Yu, Jianguo Li, Weiyao LinICLR 2024 · 5 citations
- Learned Lossless Image Compression Based on Bit Plane SlicingZhe Zhang, Huairui Wang, Zhenzhong Chen, Shan LiuCVPR 2024 · 4 citations
- DAMix: Exploiting Deep Autoregressive Model Zoo for Improving Lossless Compression GeneralizationQishi Dong, Fengwei Zhou, Ning Kang, Chuanlong Xie et al.AAAI 2023 · 3 citations
- Fitted Neural Lossless Image CompressionZhe Zhang, Zhenzhong Chen, Shan LiuCVPR 2025
Builds on12
- NVAE: A Deep Hierarchical Variational AutoencoderArash Vahdat, Jan KautzNeurIPS 2020 · 1,141 citations
- CogView: Mastering Text-to-Image Generation via TransformersMing Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng et al.NeurIPS 2021 · 1,026 citations
- Variable Rate Deep Image Compression With a Conditional AutoencoderYoojin Choi, Mostafa El-Khamy, Jungwon LeeICCV 2019 · 265 citations
- Understanding Anomaly Detection with Deep Invertible Networks through Hierarchies of Distributions and FeaturesRobin Schirrmeister, Yuxuan Zhou, Tonio Ball, Dan ZhangNeurIPS 2020 · 102 citations
- Distribution Augmentation for Generative ModelingHeewoo Jun, Rewon Child, Mark Chen, John Schulman et al.ICML 2020 · 68 citations
Related papers
- ENEC: A Lossless AI Model Compression Method Enabling Fast Inference on Ascend NPUsJinwu Yang, Jiaan Wu, Zedong Liu, Xinyang Ma et al.ISCA 2026 · 3 citations
- Lossless Compression with Probabilistic CircuitsAnji Liu, Stephan Mandt, Guy Van den BroeckICLR 2022 · 29 citations
- Learning Better Lossless Compression Using Lossy CompressionFabian Mentzer, Luc Van Gool, Michael TschannenCVPR 2020
- Get The Best of the Three Worlds: Real-Time Neural Image Compression in a Non-GPU EnvironmentZekun Zheng, Xiaodong Wang, Xinye Lin, Shaohe LvACM MM 2021 · 6 citations
- Compressing Images by Encoding Their Latent Representations with Relative Entropy CodingGergely Flamich, Marton Havasi, José Miguel Hernández-LobatoNeurIPS 2020 · 78 citations
