Transform-Free Feature Coding via Entropy-Constrained Vector Quantization
Qiaoxi Chen, Changsheng Gao, Li Li, Dong Liu
摘要
Feature coding has recently emerged as a key technique for efficient transmission of intermediate representations in distributed AI systems. Existing approaches largely follow a transform-based pipeline inherited from image and video coding, where the transform module is used to remove spatial structural redundancies in visual signals. However, our analysis indicates that such redundancies have already been largely removed during feature extraction, which reduces the necessity of the transform module. Building on this insight, we propose a new transform-free pipeline that directly encodes the extracted features via a vector quantization module and an entropy model. The proposed transform-free framework jointly learns the quantization codebook and entropy model, enabling end-to-end optimization tailored to the inherent feature characteristics. Furthermore, the proposed method inherently avoids the computational complexity of the transform module. Experiments on features from diverse architectures and tasks demonstrate that our method achieves superior rate-distortion performance compared to transform-based baselines, while significantly reducing the encoding and decoding complexity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- GShard: Scaling Giant Models with Conditional Computation and Automatic ShardingDmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen 等ICLR 2021 · 被引用 1,954 次
- ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive CodingDailan He, Ziming Yang, Weikun Peng, Rui Ma 等CVPR 2022 · 被引用 363 次
- Unified Multivariate Gaussian Mixture for Efficient Neural Image CompressionXiaosu Zhu, Jingkuan Song, Lianli Gao, Feng Zheng 等CVPR 2022 · 被引用 52 次
- Feature Coding in the Era of Large Models: Dataset, Test Conditions, and BenchmarkChangsheng Gao, Yifan Ma, Qiaoxi Chen, Yenan Xu 等ICCV 2025 · 被引用 3 次
- DT-UFC: Universal Large Model Feature Coding via Peaky-to-Balanced Distribution TransformationChangsheng Gao, Zijie Liu, Li Li, Dong Liu 等ACM MM 2025 · 被引用 2 次
相关 Paper
- Efficient Learned Image Compression without Entropy CodingHao Cao, Wenqi Guo, Zhijin Qin, Jungong HanICML 2026
- Neural NeRF CompressionTuan Pham, Stephan MandtICML 2024 · 被引用 5 次
- Bitrate-Controlled Diffusion for Disentangling Motion and Content in VideoXiao Li, Qi Chen, Xiulian Peng, Kai Yu 等ICCV 2025 · 被引用 1 次
- Joint Global and Local Hierarchical Priors for Learned Image CompressionJun-Hyuk Kim, Byeongho Heo, Jong-Seok LeeCVPR 2022 · 被引用 98 次
- Hybrid Spatial-Temporal Entropy Modelling for Neural Video CompressionJiahao Li, Bin Li, Yan LuACM MM 2022 · 被引用 202 次
