Purity Law for Neural Routing Problem Solvers with Enhanced Generalizability
Wenzhao Liu, Haoran Li, Congying Han, Zicheng Zhang, Anqi Li, Tiande Guo
Abstract
Achieving generalization in neural approaches across different scales and distributions remains a significant challenge for routing problems. A key obstacle is that neural networks often fail to learn robust principles for identifying universal patterns and deriving optimal solutions from diverse instances. In this paper, we first uncover Purity Law, a fundamental structural principle for optimal solutions of routing problems, defining that edge prevalence grows exponentially with the sparsity of surrounding vertices. Statistically and theoretically validated across diverse instances, Purity Law reveals a consistent bias toward local sparsity in global optima. Building on this insight, we propose Purity Policy Optimization (PUPO), a novel training paradigm that explicitly aligns characteristics of neural solutions with Purity Law during the solution construction process to enhance generalization. Extensive experiments demonstrate that PUPO can be seamlessly integrated with popular neural solvers, significantly enhancing their generalization performance without incurring additional computational overhead during inference. The code is available at https://github.com/Kejun0627/PUPO.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on18
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon et al.NeurIPS 2020 · 731 citations
- A Learning-based Iterative Method for Solving Vehicle Routing ProblemsHao Lu, Xingwen Zhang, Shuang YangICLR 2020 · 270 citations
- Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale GeneralizationFu Luo, Xi Lin, Fei Liu, Qingfu Zhang et al.NeurIPS 2023 · 248 citations
- Generalize a Small Pre-trained Model to Arbitrarily Large TSP InstancesZhang-Hua Fu, Kai-Bin Qiu, Hongyuan ZhaAAAI 2021 · 247 citations
- Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative TransformerYining Ma, Jingwen Li, Zhiguang Cao, Wen Song et al.NeurIPS 2021 · 230 citations
Related papers
- Learning to Solve Routing Problems via Distributionally Robust OptimizationYuan Jiang, Yaoxin Wu, Zhiguang Cao, Jie ZhangAAAI 2022 · 60 citations
- INViT: A Generalizable Routing Problem Solver with Invariant Nested View TransformerHan Fang, Zhihao Song, Paul Weng, Yutong BanICML 2024 · 39 citations
- Elite Pattern Reinforcement for Vehicle Routing ProblemsNing Li, Peng Lin, Peng Zhang, Ruichen TianAAAI 2026
- GLOP: Learning Global Partition and Local Construction for Solving Large-Scale Routing Problems in Real-TimeHaoran Ye, Jiarui Wang, Helan Liang, Zhiguang Cao et al.AAAI 2024 · 100 citations
- Scale-Net: A Hierarchical U-Net Framework for Cross-Scale Generalization in Multi-Task Vehicle RoutingSuyu Liu, Zhiguang Cao, Nan Yin, Yew-Soon OngAAAI 2026 · 1 citation
