Elite Pattern Reinforcement for Vehicle Routing Problems
Ning Li, Peng Lin, Peng Zhang, Ruichen Tian
摘要
Machine learning methods have been increasingly applied to solve Vehicle Routing Problems (VRPs). A high-efficiency approach is to learn solution construction using deep neural networks. However, their tendency toward premature convergence is a critical barrier, severely hindering generalization across diverse distributions and scales. To overcome this, we introduce Elite-Pattern Reinforcement (EPR), a novel strategy designed to create a synergy between the diverse, exploratory nature of reinforcement learning and the high-quality, structured knowledge from classical heuristics. The strategy guides the learning process by reinforcing structural patterns from elite solutions, employing an elite-guided score modulation to integrate this external knowledge. The inherent symmetry of path patterns is also exploited to augment the structural information. This steers the policy away from premature convergence by enabling it to distinguish and favour elite path patterns over inferior ones. Integrating our strategy with four construction methods yields substantial performance improvements on the CVRPLIB and TSPLIB benchmarks. Furthermore, our approach outperforms state-of-the-art learning-based methods, demonstrating superior generalization across diverse distributions and scales.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon 等NeurIPS 2020 · 被引用 731 次
- Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement LearningCong Zhang, Wen Song, Zhiguang Cao, Jie Zhang 等NeurIPS 2020 · 被引用 497 次
- DIFUSCO: Graph-based Diffusion Solvers for Combinatorial OptimizationZhiqing Sun, Yiming YangNeurIPS 2023 · 被引用 356 次
- A Learning-based Iterative Method for Solving Vehicle Routing ProblemsHao Lu, Xingwen Zhang, Shuang YangICLR 2020 · 被引用 270 次
- Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale GeneralizationFu Luo, Xi Lin, Fei Liu, Qingfu Zhang 等NeurIPS 2023 · 被引用 248 次
相关 Paper
- Ensemble-based Deep Reinforcement Learning for Vehicle Routing Problems under Distribution ShiftYuan Jiang, Zhiguang Cao, Yaoxin Wu, Wen Song 等NeurIPS 2023 · 被引用 43 次
- Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing ProblemsLiang Xin, Wen Song, Zhiguang Cao, Jie ZhangAAAI 2021 · 被引用 209 次
- Sym-NCO: Leveraging Symmetricity for Neural Combinatorial OptimizationMinsu Kim, Junyoung Park, Jinkyoo ParkNeurIPS 2022 · 被引用 200 次
- INViT: A Generalizable Routing Problem Solver with Invariant Nested View TransformerHan Fang, Zhihao Song, Paul Weng, Yutong BanICML 2024 · 被引用 39 次
- USPR: Learning a Unified Solver for Profiled RoutingChuanbo Hua, Federico Berto, Zhikai Zhao, Jiwoo Son 等AAAI 2026 · 被引用 2 次
