Variational Bayesian Quantization
Yibo Yang, Robert Bamler, Stephan Mandt
Abstract
Compressed sensing (CS) is on recovery of high dimensional signals from their low dimensional linear measurements under a sparsity prior and digital quantization of the measurement data is inevitable in practical implementation of CS algorithms. In the existing literature, the quantization error is modeled typically as additive noise and the multi-bit and 1-bit quantized CS problems are dealt with separately using different treatments and procedures. In this paper, a novel variational Bayesian inference based CS algorithm is presented, which unifies the multi- and 1-bit CS processing and is applicable to various cases of noiseless/noisy environment and unsaturated/saturated quantizer. By decoupling the quantization error from the measurement noise, the quantization error is modeled as a random variable and estimated jointly with the signal being recovered. Such a novel characterization of the quantization error results in superior performance of the algorithm which is demonstrated by extensive simulations in comparison with state-of-the-art methods for both multi-bit and 1-bit CS problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 302654be-25bf-4662-89fe-b722bfc2d951Cited by top-tier papers8
- Improving Inference for Neural Image CompressionYibo Yang, Robert Bamler, Stephan MandtNeurIPS 2020 · 151 citations
- Lossy Compression for Lossless PredictionYann Dubois, Benjamin Bloem-Reddy, Karen Ullrich, Chris J. MaddisonNeurIPS 2021 · 82 citations
- Hierarchical Autoregressive Modeling for Neural Video CompressionRuihan Yang, Yibo Yang, Joseph Marino, Stephan MandtICLR 2021 · 48 citations
- Computationally-Efficient Neural Image Compression with Shallow DecodersYibo Yang, Stephan MandtICCV 2023 · 43 citations
- Towards Empirical Sandwich Bounds on the Rate-Distortion FunctionYibo Yang, Stephan MandtICLR 2022 · 28 citations
Builds on2
Related papers
- QCS-SGM+: Improved Quantized Compressed Sensing with Score-Based Generative ModelsXiangming Meng, Yoshiyuki KabashimaAAAI 2024 · 2 citations
- Quantized Compressed Sensing with Score-Based Generative ModelsXiangming Meng, Yoshiyuki KabashimaICLR 2023 · 3 citations
- Unified Multivariate Gaussian Mixture for Efficient Neural Image CompressionXiaosu Zhu, Jingkuan Song, Lianli Gao, Feng Zheng et al.CVPR 2022 · 52 citations
- Bayesian Bits: Unifying Quantization and PruningMart van Baalen, Christos Louizos, Markus Nagel, Rana Ali Amjad et al.NeurIPS 2020 · 149 citations
- Sample Complexity Bounds for 1-bit Compressive Sensing and Binary Stable Embeddings with Generative PriorsZhaoqiang Liu, Selwyn Gomes, Avtansh Tiwari, Jonathan ScarlettICML 2020 · 30 citations
