Sampling from Binary Quadratic Distributions via Stochastic Localization
Chenguang Wang, Kaiyuan Cui, Weichen Zhao, Tianshu Yu
摘要
Sampling from binary quadratic distributions (BQDs) is a fundamental but challenging problem in discrete optimization and probabilistic inference. Previous work established theoretical guarantees for stochastic localization (SL) in continuous domains, where MCMC methods efficiently estimate the required posterior expectations during SL iterations. However, achieving similar convergence guarantees for discrete MCMC samplers in posterior estimation presents unique theoretical challenges. In this work, we present the first application of SL to general BQDs, proving that after a certain number of iterations, the external field of posterior distributions constructed by SL tends to infinity almost everywhere, hence satisfy Poincaré inequalities with probability near to 1, leading to polynomial-time mixing. This theoretical breakthrough enables efficient sampling from general BQDs, even those that may not originally possess fast mixing properties. Furthermore, our analysis, covering enormous discrete MCMC samplers based on Glauber dynamics and Metropolis-Hastings algorithms, demonstrates the broad applicability of our theoretical framework. Experiments on instances with quadratic unconstrained binary objectives, including maximum independent set, maximum cut, and maximum clique problems, demonstrate consistent improvements in sampling efficiency across different discrete MCMC samplers.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Oops I Took A Gradient: Scalable Sampling for Discrete DistributionsWill Grathwohl, Kevin Swersky, Milad Hashemi, David Duvenaud 等ICML 2021 · 被引用 113 次
相关 Paper
- Weak Poincaré Inequalities, Simulated Annealing, and Sampling from Spherical Spin GlassesBrice Huang, Sidhanth Mohanty, Amit Rajaraman, David X. WuSTOC 2025 · 被引用 13 次
- Stochastic Localization via Iterative Posterior SamplingLouis Grenioux, Maxence Noble, Marylou Gabrié, Alain Oliviero DurmusICML 2024 · 被引用 28 次
- Localization Schemes: A Framework for Proving Mixing Bounds for Markov Chains (extended abstract)Yuansi Chen, Ronen EldanFOCS 2022 · 被引用 42 次
- Rapid Mixing from Spectral Independence beyond the Boolean DomainWeiming Feng, Heng Guo, Yitong Yin, Chihao ZhangSODA 2021 · 被引用 18 次
- Trickle-Down in Localization Schemes and ApplicationsNima Anari, Frederic Koehler, Thuy-Duong VuongSTOC 2024 · 被引用 2 次
