Preference-Modulated Structural Attention for Multi-Objective Combinatorial Optimization
Rongsheng Jia, Jun Zhang, Yifan Zhang, Jian Cheng
Abstract
Recent decomposition-based approaches have achieved significant success in Multi-Objective Combinatorial Optimization (MOCO). However, existing methods typically rely exclusively on node-centric representations, failing to capture the complementary representations provided by edge features for problem instances, resulting in a persistent optimality gap. To address this, we propose a preference-modulated structural attention mechanism to enhance problem representation by synergizing node and edge features. It includes:
(1) Utilizing preference-modulated edge features as explicit structural biases during attention calculation, enabling model to perceive sub-problem structures conditioned on specific preferences, and (2) an edge feature aggregation strategy that dynamically incorporates node-specific context into edge representations to enhance the perception of preference-aware structures. Experiments on classic MOCOP benchmarks demonstrate the superiority of our approach in terms of both performance and generalization capabilities.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- Pareto Set Learning for Neural Multi-Objective Combinatorial OptimizationXi Lin, Zhiyuan Yang, Qingfu ZhangICLR 2022 · 105 citations
- Towards Omni-generalizable Neural Methods for Vehicle Routing ProblemsJianan Zhou, Yaoxin Wu, Wen Song, Zhiguang Cao et al.ICML 2023 · 90 citations
- Global Self-Attention as a Replacement for Graph ConvolutionMd. Shamim Hussain, Mohammed J. Zaki, Dharmashankar SubramanianKDD 2022 · 88 citations
- Efficient Meta Neural Heuristic for Multi-Objective Combinatorial OptimizationJinbiao Chen, Jiahai Wang, Zizhen Zhang, Zhiguang Cao et al.NeurIPS 2023 · 35 citations
- Neural Multi-Objective Combinatorial Optimization with Diversity EnhancementJinbiao Chen, Zizhen Zhang, Zhiguang Cao, Yaoxin Wu et al.NeurIPS 2023 · 31 citations
Related papers
- Rethinking Neural Multi-Objective Combinatorial Optimization via Neat Weight EmbeddingJinbiao Chen, Zhiguang Cao, Jiahai Wang, Yaoxin Wu et al.ICLR 2025
- Neural Multi-Objective Combinatorial Optimization via Graph-Image Multimodal FusionJinbiao Chen, Jiahai Wang, Zhiguang Cao, Yaoxin WuICLR 2025
- Preference-Driven Multi-Objective Combinatorial Optimization with Conditional ComputationMingfeng Fan, Jianan Zhou, Yifeng Zhang, Yaoxin Wu et al.NeurIPS 2025 · 7 citations
- Neural Multi-Objective Combinatorial Optimization for Flexible Job Shop Scheduling ProblemsIgor G. Smit, Yaoxin Wu, Pavel Troubil, Yingqian Zhang et al.ICLR 2026 · 3 citations
- A General Neural Backbone for Mixed-Integer Linear Optimization via Dual AttentionPeixin Huang, Yaoxin Wu, Yining Ma, Cathy Wu et al.ICML 2026
