Generation as Search Operator for Test-Time Scaling of Diffusion-based Combinatorial Optimization
Yang Li, Lvda Chen, Haonan Wang, Runzhong Wang, Junchi Yan
Abstract
While diffusion models have shown promise for combinatorial optimization (CO), their inference-time scaling cost-efficiency remains relatively underexplored. Existing methods improve solution quality by increasing denoising steps, but the performance often becomes saturated quickly. This paper proposes GenSCO to systematically scale diffusion solvers by an orthogonal dimension of inference-time computation beyond denoising step expansion, i.e., search-driven generation. Gen-SCO takes generation as a search operator rather than a complete solving process, where each operator cycle combines solution disruption (via local search operators) and diffusion sampling, enabling iterative exploration of the learned solution space. Rather than over-refining current solutions, this paradigm encourages the model to leave local optima and explore a broader area of the solution space, ensuring a more consistent scaling effect. The search loop is supported by a search-friendly solution-enhancement training procedure that incorporates a rectified flow model learning to establish diffusion trajectories between suboptimal solutions and the optimal ones. The flow model is empowered by a lightweight transformer architecture to learn neural ODEs that linearize solution trajectories, accelerating convergence of the scaling effect with efficiency. The resulting enhanced scaling efficiency and practical scalability lead to synergistic performance improvements. Extensive experiments show that GenSCO delivers performance improvements by orders of magnitude over previous state-of-the-art neural methods. Notably, GenSCO even achieves significant speedups compared to the state-of-the-art classic mathematical solver LKH3, delivering a 141 × speedup to reach 0.000% optimality gap on TSP-100, and approximately a 10 × speedup to reach 0.02% on TSP-500.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e15429f7-0d13-452a-a4fc-099bb39b1c9bCited by top-tier papers11
- Attention Illuminates LLM Reasoning: The Uncovered Preplan-and-Anchor Rhythm Enables Fine-Grained Policy OptimizationYang Li, Zhichen Dong, Yuhan Sun, Weixun Wang et al.ICML 2026 · 25 citations
- Fractional Langevin Dynamics for Combinatorial Optimization via Polynomial-Time EscapeShiyue Wang, Ziao Guo, Changhong Lu, Junchi YanNeurIPS 2025 · 5 citations
- FRIGID: Scaling Diffusion-Based Molecular Generation from Mass Spectra at Training and Inference TimeMontgomery Bohde, Hongxuan Liu, Mrunali Manjrekar, Magdalena Lederbauer et al.ICML 2026 · 3 citations
- How Does Reasoning Flow? Tracing Attention-Induced Information Flow for Targeted RL in LLMsZhichen Dong, Yang Li, Yuhan Sun, Weixun Wang et al.ICML 2026 · 1 citation
- Unsupervised Diffusion Solver for Combinatorial Optimization via Combinatorial Adjoint MatchingShengyu Feng, Tarun Suresh, Yiming YangICML 2026 · 1 citation
Builds on55
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow et al.NeurIPS 2021 · 2,256 citations
Related papers
- Efficient Few-Step Solution Generation via Discrete Flow Matching for Combinatorial OptimizationYuanshu Li, Di Wang, Wei Du, Xuan Wu et al.AAAI 2026 · 1 citation
- Native Adaptive Solution Expansion for Diffusion-based Combinatorial OptimizationYu Wang, Yang Li, Jiale Ma, Junchi Yan et al.ICLR 2026
- StruDiCO: Structured Denoising Diffusion with Gradient-free Inference-stage Boosting for Memory and Time Efficient Combinatorial OptimizationYu Wang, Yang Li, Junchi Yan, Yi ChangNeurIPS 2025 · 1 citation
- From Distribution Learning in Training to Gradient Search in Testing for Combinatorial OptimizationYang Li, Jinpei Guo, Runzhong Wang, Junchi YanNeurIPS 2023 · 115 citations
- Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time AdaptationHaoyu Lei, Kaiwen Zhou, Yinchuan Li, Zhitang Chen et al.AAAI 2026 · 1 citation
