Inference-time scaling of diffusion models through classical search
Xiangcheng Zhang, Haowei Lin, Haotian Ye, James Y. Zou, Jianzhu Ma, Yitao Liang, Yilun Du
Abstract
Classical search algorithms have long underpinned modern artificial intelligence. In this work, we tackle the challenge of inference-time control in diffusion models-adapting generated outputs to meet diverse test-time objectives-using principles from classical search. We propose a general framework that orchestrates local and global search to efficiently navigate the generative space. It performs compute-efficient global exploration using breadth-first and depth-first tree search and employs a theoretically grounded, scalable local search via annealed Langevin MCMC. We evaluate our approach on a range of challenging domains, including planning, offline reinforcement learning, and image generation, and observe significant gains in both performance and efficiency over baseline methods. These results demonstrate that classical search offers a principled and practical foundation for inference-time scaling in diffusion models. By jointly scaling local and global search for the first time, our framework establishes a new Pareto frontier across challenging decision-making domains. Project page at diffusion-inferencescaling.github.io.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a4e0130a-3a84-4a67-bb43-35b01e53a1c0Cited by top-tier papers15
- Reasoning with Sampling: Your Base Model is Smarter Than You ThinkAayush Karan, Yilun DuICLR 2026 · 87 citations
- Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order AlgorithmsYinuo Ren, Haoxuan Chen, Yuchen Zhu, Wei Guo et al.NeurIPS 2025 · 51 citations
- Inference-time Physics Alignment of Video Generative Models with Latent World ModelsJianhao Yuan, Xiaofeng Zhang, Felix Friedrich, Nicolas Beltran-Velez et al.CVPR 2026 · 32 citations
- Meta Flow Maps enable scalable reward alignmentPeter Potaptchik, Adhi Saravanan, Abbas Mammadov, Alvaro Prat et al.ICML 2026 · 25 citations
- Diamond Maps: Efficient Reward Alignment via Stochastic Flow MapsPeter Holderrieth, Douglas Chen, Luca Eyring, Ishin Shah et al.ICML 2026 · 18 citations
Builds on37
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationJunnan Li, Dongxu Li, Caiming Xiong, Steven C. H. HoiICML 2022 · 6,549 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
Related papers
- Diffusion Tree Sampling: Scalable inference‑time alignment of diffusion modelsVineet Jain, Kusha Sareen, Mohammad Pedramfar, Siamak RavanbakhshNeurIPS 2025 · 41 citations
- Monte Carlo Tree Diffusion for System 2 PlanningJaesik Yoon, Hyeonseo Cho, Doojin Baek, Yoshua Bengio et al.ICML 2025
- Adaptive Inference-Time Scaling via Cyclic Diffusion SearchGyubin Lee, Bao Truong, Jaesik Yoon, Dongwoo Lee et al.NeurIPS 2025 · 9 citations
- Controllable Graph Generation with Diffusion Models via Inference-Time Tree Search GuidanceJiachi Zhao, Zehong Wang, Yamei Liao, Chuxu Zhang et al.WWW 2026 · 4 citations
- UnMaskFork: Test-Time Scaling for Masked Diffusion via Deterministic Action BranchingKou Misaki, Takuya AkibaICML 2026 · 1 citation
