Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalization
Fei Liu, Xi Lin, Zhenkun Wang, Qingfu Zhang, Xialiang Tong, Mingxuan Yuan
Abstract
Vehicle routing problems (VRPs), which can be found in numerous real-world applications, have been an important research topic for several decades. Recently, the neural combinatorial optimization (NCO) approach that leverages a learning-based model to solve VRPs without manual algorithm design has gained substantial attention. However, current NCO methods typically require building one model for each routing problem, which significantly hinders their practical application for real-world industry problems with diverse attributes. In this work, we make the first attempt to tackle the crucial challenge of cross-problem generalization. In particular, we formulate VRPs as different combinations of a set of shared underlying attributes and solve them simultaneously via a single model through attribute composition. In this way, our proposed model can successfully solve VRPs with unseen attribute combinations in a zero-shot generalization manner. Extensive experiments are conducted on eleven VRP variants, benchmark datasets, and industry logistic scenarios. The results show that the unified model demonstrates superior performance in the eleven VRPs, reducing the average gap to around 5% from over 20% in the existing approach and achieving a significant performance boost on benchmark datasets as well as a real-world logistics application. The source code is included in https://github.com/FeiLiu36/MTNCO .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers33
- MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-ExpertsJianan Zhou, Zhiguang Cao, Yaoxin Wu, Wen Song et al.ICML 2024 · 74 citations
- Learning to Reduce Search Space for Generalizable Neural Routing SolverChangliang Zhou, Xi Lin, Zhenkun Wang, Qingfu ZhangKDD 2026 · 17 citations
- Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection LearningYuanyao Chen, Rongsheng Chen, Fu Luo, Zhenkun WangNeurIPS 2025 · 16 citations
- RRNCO: Towards Real-World Routing with Neural Combinatorial OptimizationJiwoo Son, Zhikai Zhao, Federico Berto, Chuanbo Hua et al.ICLR 2026 · 15 citations
- PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial OptimizationFederico Berto, Chuanbo Hua, Laurin Luttmann, Jiwoo Son et al.NeurIPS 2025 · 14 citations
Builds on9
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon et al.NeurIPS 2020 · 731 citations
- Generalize a Small Pre-trained Model to Arbitrarily Large TSP InstancesZhang-Hua Fu, Kai-Bin Qiu, Hongyuan ZhaAAAI 2021 · 247 citations
- Simulation-guided Beam Search for Neural Combinatorial OptimizationJinho Choo, Yeong-Dae Kwon, Jihoon Kim, Jeongwoo Jae et al.NeurIPS 2022 · 123 citations
- Learning Generalizable Models for Vehicle Routing Problems via Knowledge DistillationJieyi Bi, Yining Ma, Jiahai Wang, Zhiguang Cao et al.NeurIPS 2022 · 114 citations
- Pareto Set Learning for Neural Multi-Objective Combinatorial OptimizationXi Lin, Zhiyuan Yang, Qingfu ZhangICLR 2022 · 105 citations
Related papers
- URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot GeneralizationChangliang Zhou, Canhong Yu, Shunyu Yao, Xi Lin et al.ICML 2026 · 12 citations
- CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-AttentionHan Li, Fei Liu, Zhi Zheng, Yu Zhang et al.ICML 2025
- Combination-of-Experts with Knowledge Sharing for Cross-Task Vehicle Routing ProblemsZikang Yu, Jinbiao Chen, Jiahai WangICLR 2026
- MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing SolverYuepeng Zheng, Fu Luo, Zhenkun Wang, Yaoxin Wu et al.NeurIPS 2025 · 13 citations
- Boosting Neural Combinatorial Optimization for Large-Scale Vehicle Routing ProblemsFu Luo, Xi Lin, Yaoxin Wu, Zhenkun Wang et al.ICLR 2025
