Preference-Driven Multi-Objective Combinatorial Optimization with Conditional Computation
Mingfeng Fan, Jianan Zhou, Yifeng Zhang, Yaoxin Wu, Jinbiao Chen, Guillaume Sartoretti
Abstract
Recent deep reinforcement learning methods have achieved remarkable success in solving multi-objective combinatorial optimization problems (MOCOPs) by decomposing them into multiple subproblems, each associated with a specific weight vector. However, these methods typically treat all subproblems equally and solve them using a single model, hindering the effective exploration of the solution space and thus leading to suboptimal performance. To overcome the limitation, we propose POCCO, a novel plug-and-play framework that enables adaptive selection of model structures for subproblems, which are subsequently optimized based on preference signals rather than explicit reward values. Specifically, we design a conditional computation block that routes subproblems to specialized neural architectures. Moreover, we propose a preference-driven optimization algorithm that learns pairwise preferences between winning and losing solutions. We evaluate the efficacy and versatility of POCCO by applying it to two state-of-the-art neural methods for MOCOPs. Experimental results across four classic MOCOP benchmarks demonstrate its significant superiority and strong generalization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3d80fc2e-1047-43e6-b9bc-085fb64e6879Cited by top-tier papers4
- Towards Efficient Constraint Handling in Neural Solvers for Routing ProblemsJieyi Bi, Zhiguang Cao, Jianan Zhou, Wen Song et al.ICLR 2026 · 5 citations
- Beyond Simple Graphs: Neural Multi-Objective Routing on MultigraphsFilip Rydin, Attila Lischka, Jiaming Wu, Morteza Haghir Chehreghani et al.ICLR 2026 · 2 citations
- PoMtVRS: Preference-Optimized Multi-Task Vehicle Routing Solver with Preference GatingDian Meng, Yaoxin Wu, Yaqing Hou, Zhiguang CaoICML 2026
- Preference-Modulated Structural Attention for Multi-Objective Combinatorial OptimizationRongsheng Jia, Jun Zhang, Yifan Zhang, Jian ChengICML 2026
Builds on16
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- SimPO: Simple Preference Optimization with a Reference-Free RewardYu Meng, Mengzhou Xia, Danqi ChenNeurIPS 2024 · 1,203 citations
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon et al.NeurIPS 2020 · 731 citations
- Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained TransformersLirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming HeNeurIPS 2024 · 208 citations
- Learning to delegate for large-scale vehicle routingSirui Li, Zhongxia Yan, Cathy WuNeurIPS 2021 · 181 citations
Related papers
- Pareto Set Learning for Neural Multi-Objective Combinatorial OptimizationXi Lin, Zhiyuan Yang, Qingfu ZhangICLR 2022 · 105 citations
- DeepACO: Neural-enhanced Ant Systems for Combinatorial OptimizationHaoran Ye, Jiarui Wang, Zhiguang Cao, Helan Liang et al.NeurIPS 2023 · 158 citations
- Graph-Supported Dynamic Algorithm Configuration for Multi-Objective Combinatorial OptimizationRobbert Reijnen, Yaoxin Wu, Zaharah Bukhsh, Yingqian ZhangICML 2025
- Neural Multi-Objective Combinatorial Optimization for Flexible Job Shop Scheduling ProblemsIgor G. Smit, Yaoxin Wu, Pavel Troubil, Yingqian Zhang et al.ICLR 2026 · 3 citations
- Neural Multi-Objective Combinatorial Optimization with Diversity EnhancementJinbiao Chen, Zizhen Zhang, Zhiguang Cao, Yaoxin Wu et al.NeurIPS 2023 · 31 citations
