Fractional Langevin Dynamics for Combinatorial Optimization via Polynomial-Time Escape
Shiyue Wang, Ziao Guo, Changhong Lu, Junchi Yan
Abstract
Langevin dynamics (LD) and its discrete proposal have been widely applied in the field of Combinatorial Optimization (CO). Both sampling-based and data-driven approaches have benefited significantly from these methods. However, LD’s reliance on Gaussian noise limits its ability to escape narrow local optima, requires costly parallel chains, and performs poorly in rugged landscapes or with non-strict constraints. These challenges have impeded the development of more advanced approaches. To address these issues, we introduce fractional Langevin dynamics (FLD) for CO, replacing Gaussian noise with α -stable Lévy noise. FLD can escape from local optima more readily via Lévy flights, and in multiple-peak CO problems with high potential barriers it exhibits a polynomial escape time that outperforms the exponential escape time of LD. Moreover, FLD coincides with LD when α = 2 , and by tuning α it can be adapted to a wider range of complex scenarios in the CO field. We provide theoretical proof that our method offers enhanced exploration capabilities and improved convergence. Experimental results on the Maximum Independent Set, Maximum Clique, and Maximum Cut problems demonstrate that incorporating FLD advances both sampling-based and data-driven approaches, achieving state-of-the-art (SOTA) performance in most of the experiments. The codes are publicly available at https://github.com/Thinklab-SJTU/FLD4CO.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7eebc7b9-13a9-4097-bc28-736827673bddCited by top-tier papers4
- Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-TuningYibin Wang, Zhimin Li, Yuhang Zang, Chunyu Wang et al.NeurIPS 2025 · 102 citations
- Generation as Search Operator for Test-Time Scaling of Diffusion-based Combinatorial OptimizationYang Li, Lvda Chen, Haonan Wang, Runzhong Wang et al.NeurIPS 2025 · 13 citations
- ConRep4CO: Contrastive Representation Learning of Combinatorial Optimization Instances across TypesZiao Guo, Yang Li, Shiyue Wang, Junchi YanICLR 2026
- MaskCO: Masked Generation Drives Effective Representation Learning and Exploiting for Combinatorial OptimizationLvda Chen, Yang Li, Junchi YanICLR 2026
Builds on23
- DIFUSCO: Graph-based Diffusion Solvers for Combinatorial OptimizationZhiqing Sun, Yiming YangNeurIPS 2023 · 356 citations
- Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on GraphsNikolaos Karalias, Andreas LoukasNeurIPS 2020 · 190 citations
- DIMES: A Differentiable Meta Solver for Combinatorial Optimization ProblemsRuizhong Qiu, Zhiqing Sun, Yiming YangNeurIPS 2022 · 183 citations
- Hybrid Models for Learning to BranchPrateek Gupta, Maxime Gasse, Elias B. Khalil, Pawan Kumar Mudigonda et al.NeurIPS 2020 · 179 citations
- Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-TuningYibin Wang, Zhimin Li, Yuhang Zang, Chunyu Wang et al.NeurIPS 2025 · 102 citations
Related papers
- Regularized Langevin Dynamics for Combinatorial OptimizationShengyu Feng, Yiming YangICML 2025
- Score-based Generative Models with Lévy ProcessesEun-Bi Yoon, Keehun Park, Sungwoong Kim, Sungbin LimNeurIPS 2023 · 42 citations
- On the Theoretical Properties of Noise Correlation in Stochastic OptimizationAurélien Lucchi, Frank Proske, Antonio Orvieto, Francis R. Bach et al.NeurIPS 2022 · 9 citations
- Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient NoiseUmut Simsekli, Lingjiong Zhu, Yee Whye Teh, Mert GürbüzbalabanICML 2020 · 58 citations
- Unsupervised Neural Langevin Sampler for Mixed Integer Linear ProgrammingYixin Huang, Shengyu Feng, Yiming YangICML 2026
