Elite Pattern Reinforcement for Vehicle Routing Problems
Ning Li, Peng Lin, Peng Zhang, Ruichen Tian
Abstract
Machine learning methods have been increasingly applied to solve Vehicle Routing Problems (VRPs). A high-efficiency approach is to learn solution construction using deep neural networks. However, their tendency toward premature convergence is a critical barrier, severely hindering generalization across diverse distributions and scales. To overcome this, we introduce Elite-Pattern Reinforcement (EPR), a novel strategy designed to create a synergy between the diverse, exploratory nature of reinforcement learning and the high-quality, structured knowledge from classical heuristics. The strategy guides the learning process by reinforcing structural patterns from elite solutions, employing an elite-guided score modulation to integrate this external knowledge. The inherent symmetry of path patterns is also exploited to augment the structural information. This steers the policy away from premature convergence by enabling it to distinguish and favour elite path patterns over inferior ones. Integrating our strategy with four construction methods yields substantial performance improvements on the CVRPLIB and TSPLIB benchmarks. Furthermore, our approach outperforms state-of-the-art learning-based methods, demonstrating superior generalization across diverse distributions and scales.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon et al.NeurIPS 2020 · 731 citations
- Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement LearningCong Zhang, Wen Song, Zhiguang Cao, Jie Zhang et al.NeurIPS 2020 · 497 citations
- DIFUSCO: Graph-based Diffusion Solvers for Combinatorial OptimizationZhiqing Sun, Yiming YangNeurIPS 2023 · 356 citations
- A Learning-based Iterative Method for Solving Vehicle Routing ProblemsHao Lu, Xingwen Zhang, Shuang YangICLR 2020 · 270 citations
- Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale GeneralizationFu Luo, Xi Lin, Fei Liu, Qingfu Zhang et al.NeurIPS 2023 · 248 citations
Related papers
- Ensemble-based Deep Reinforcement Learning for Vehicle Routing Problems under Distribution ShiftYuan Jiang, Zhiguang Cao, Yaoxin Wu, Wen Song et al.NeurIPS 2023 · 43 citations
- Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing ProblemsLiang Xin, Wen Song, Zhiguang Cao, Jie ZhangAAAI 2021 · 209 citations
- Sym-NCO: Leveraging Symmetricity for Neural Combinatorial OptimizationMinsu Kim, Junyoung Park, Jinkyoo ParkNeurIPS 2022 · 200 citations
- INViT: A Generalizable Routing Problem Solver with Invariant Nested View TransformerHan Fang, Zhihao Song, Paul Weng, Yutong BanICML 2024 · 39 citations
- USPR: Learning a Unified Solver for Profiled RoutingChuanbo Hua, Federico Berto, Zhikai Zhao, Jiwoo Son et al.AAAI 2026 · 2 citations
