Generation as Search Operator for Test-Time Scaling of Diffusion-based Combinatorial Optimization
Yang Li, Lvda Chen, Haonan Wang, Runzhong Wang, Junchi Yan
摘要
While diffusion models have shown promise for combinatorial optimization (CO), their inference-time scaling cost-efficiency remains relatively underexplored. Existing methods improve solution quality by increasing denoising steps, but the performance often becomes saturated quickly. This paper proposes GenSCO to systematically scale diffusion solvers by an orthogonal dimension of inference-time computation beyond denoising step expansion, i.e., search-driven generation. Gen-SCO takes generation as a search operator rather than a complete solving process, where each operator cycle combines solution disruption (via local search operators) and diffusion sampling, enabling iterative exploration of the learned solution space. Rather than over-refining current solutions, this paradigm encourages the model to leave local optima and explore a broader area of the solution space, ensuring a more consistent scaling effect. The search loop is supported by a search-friendly solution-enhancement training procedure that incorporates a rectified flow model learning to establish diffusion trajectories between suboptimal solutions and the optimal ones. The flow model is empowered by a lightweight transformer architecture to learn neural ODEs that linearize solution trajectories, accelerating convergence of the scaling effect with efficiency. The resulting enhanced scaling efficiency and practical scalability lead to synergistic performance improvements. Extensive experiments show that GenSCO delivers performance improvements by orders of magnitude over previous state-of-the-art neural methods. Notably, GenSCO even achieves significant speedups compared to the state-of-the-art classic mathematical solver LKH3, delivering a 141 × speedup to reach 0.000% optimality gap on TSP-100, and approximately a 10 × speedup to reach 0.02% on TSP-500.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- Attention Illuminates LLM Reasoning: The Uncovered Preplan-and-Anchor Rhythm Enables Fine-Grained Policy OptimizationYang Li, Zhichen Dong, Yuhan Sun, Weixun Wang 等ICML 2026 · 被引用 25 次
- Fractional Langevin Dynamics for Combinatorial Optimization via Polynomial-Time EscapeShiyue Wang, Ziao Guo, Changhong Lu, Junchi YanNeurIPS 2025 · 被引用 5 次
- FRIGID: Scaling Diffusion-Based Molecular Generation from Mass Spectra at Training and Inference TimeMontgomery Bohde, Hongxuan Liu, Mrunali Manjrekar, Magdalena Lederbauer 等ICML 2026 · 被引用 3 次
- How Does Reasoning Flow? Tracing Attention-Induced Information Flow for Targeted RL in LLMsZhichen Dong, Yang Li, Yuhan Sun, Weixun Wang 等ICML 2026 · 被引用 1 次
- Unsupervised Diffusion Solver for Combinatorial Optimization via Combinatorial Adjoint MatchingShengyu Feng, Tarun Suresh, Yiming YangICML 2026 · 被引用 1 次
它引用的顶会 Paper55
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 被引用 11,724 次
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 被引用 5,234 次
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow 等NeurIPS 2021 · 被引用 2,256 次
相关 Paper
- Efficient Few-Step Solution Generation via Discrete Flow Matching for Combinatorial OptimizationYuanshu Li, Di Wang, Wei Du, Xuan Wu 等AAAI 2026 · 被引用 1 次
- Native Adaptive Solution Expansion for Diffusion-based Combinatorial OptimizationYu Wang, Yang Li, Jiale Ma, Junchi Yan 等ICLR 2026
- StruDiCO: Structured Denoising Diffusion with Gradient-free Inference-stage Boosting for Memory and Time Efficient Combinatorial OptimizationYu Wang, Yang Li, Junchi Yan, Yi ChangNeurIPS 2025 · 被引用 1 次
- From Distribution Learning in Training to Gradient Search in Testing for Combinatorial OptimizationYang Li, Jinpei Guo, Runzhong Wang, Junchi YanNeurIPS 2023 · 被引用 115 次
- Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time AdaptationHaoyu Lei, Kaiwen Zhou, Yinchuan Li, Zhitang Chen 等AAAI 2026 · 被引用 1 次
