Efficient Diffusion Models under Nonconvex Equality and Inequality constraints via Landing
Kijung Jeon, Michael Muehlebach, Molei Tao
Abstract
Generative modeling within constrained sets is essential for scientific and engineering applications involving physical, geometric, or safety requirements (e.g., molecular generation, robotics). We present a unified framework for constrained diffusion models on generic nonconvex feasible sets that simultaneously enforces equality and inequality constraints throughout the diffusion process. Our framework incorporates both overdamped and underdamped dynamics for forward and backward sampling. A key algorithmic innovation is a computationally efficient landing mechanism that replaces costly and often ill-defined projections onto , ensuring feasibility without iterative Newton solves or projection failures. By leveraging underdamped dynamics, we accelerate mixing toward the prior distribution, effectively alleviating the high simulation costs typically associated with constrained diffusion. Empirically, this approach reduces function evaluations and memory usage during both training and inference while preserving sample quality. On benchmarks featuring equality and mixed constraints, our method achieves comparable sample quality to state-of-the-art baselines while significantly reducing computational cost, providing a practical and scalable solution for diffusion on nonconvex feasible sets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 55845b99-8cce-41b4-ae91-cbe2ee249a0bBuilds on22
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
Related papers
- Fast Non-Log-Concave Sampling under Nonconvex Equality and Inequality Constraints with LandingKijung Jeon, Michael Muehlebach, Molei TaoNeurIPS 2025 · 5 citations
- Gauge Flow Matching: Efficient Constrained Generative Modeling over General Convex Set and BeyondXinpeng Li, Enming Liang, Minghua ChenICLR 2026
- Constrained Synthesis with Projected Diffusion ModelsJacob K. Christopher, Stephen Baek, Ferdinando FiorettoNeurIPS 2024 · 110 citations
- Underdamped Diffusion Bridges with Applications to SamplingDenis Blessing, Julius Berner, Lorenz Richter, Gerhard NeumannICLR 2025
- Metropolis Sampling for Constrained Diffusion ModelsNic Fishman, Leo Klarner, Emile Mathieu, Michael J. Hutchinson et al.NeurIPS 2023 · 37 citations
