Constrained Particle Seeking: Solving Diffusion Inverse Problems with Just Forward Passes
Hongkun Dou, Zike Chen, Zeyu Li, Hongjue Li, Lijun Yang, Yue Deng
Abstract
Diffusion models have gained prominence as powerful generative tools for solving inverse problems due to their ability to model complex data distributions. However, existing methods typically rely on complete knowledge of the forward observation process to compute gradients for guided sampling, limiting their applicability in scenarios where such information is unavailable. In this work, we introduce Constrained Particle Seeking (CPS), a novel gradient-free approach that leverages all candidate particle information to actively search for the optimal particle while incorporating constraints aligned with high-density regions of the unconditional prior. Unlike previous methods that passively select promising candidates, CPS reformulates the inverse problem as a constrained optimization task, enabling more flexible and efficient particle seeking. We demonstrate that CPS can effectively solve both image and scientific inverse problems, achieving results comparable to gradient-based methods while significantly outperforming gradient-free alternatives. Code is available at https://github.com/deng-ai-lab/CPS .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on19
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Solving Inverse Problems in Medical Imaging with Score-Based Generative ModelsYang Song, Liyue Shen, Lei Xing, Stefano ErmonICLR 2022 · 721 citations
Related papers
- Constrained Diffusion with Trust SamplingWilliam Huang, Yifeng Jiang, Tom Van Wouwe, C. Karen LiuNeurIPS 2024 · 13 citations
- Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct SupervisionAyush Tewari, Tianwei Yin, George Cazenavette, Semon Rezchikov et al.NeurIPS 2023 · 131 citations
- Coupled Data and Measurement Space Dynamics for Enhanced Diffusion Posterior SamplingShayan Mohajer Hamidi, Ben Liang, En-Hui YangNeurIPS 2025 · 2 citations
- Divide-and-Conquer Posterior Sampling for Denoising Diffusion priorsYazid Janati, Badr Moufad, Alain Durmus, Eric Moulines et al.NeurIPS 2024 · 34 citations
- Rethinking Diffusion Posterior Sampling: From Conditional Score Estimator to Maximizing a PosteriorTongda Xu, Xiyan Cai, Xinjie Zhang, Xingtong Ge et al.ICLR 2025
