Evolving Interdependent Operators with Large Language Models for Multi-Objective Combinatorial Optimization
Junhao Qiu, Xin Chen, LiangGE, Liyong Lin, Zhichao Lu, Qingfu Zhang
Abstract
Neighborhood search operators are critical to the performance of Multi-Objective Evolutionary Algorithms (MOEAs) and rely heavily on expert design. Although recent LLM-based Automated Heuristic Design (AHD) methods have made notable progress, they primarily optimize individual heuristics or components independently, lacking explicit exploration and exploitation of dynamic coupling relationships between operators. In this paper, multi-operator optimization in MOEAs is formulated as a Markov decision process, enabling the improvement of interdependent operators through sequential decision-making. To address this, we propose the Evolution of Operator Combination (E2OC) framework for MOEAs, which achieves the co-evolution of design strategies and executable codes. E2OC employs Monte Carlo Tree Search to progressively search combinations of operator design strategies and adopts an operator rotation mechanism to identify effective operator configurations while supporting the integration of mainstream AHD methods as the underlying designer. Experimental results across AHD tasks with varying objectives and problem scales show that E2OC consistently outperforms state-of-the-art AHD and other multi-heuristic co-design frameworks, demonstrating strong generalization and sustained optimization capability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Reflexion: language agents with verbal reinforcement learningNoah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan et al.NeurIPS 2023 · 5,828 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
- ReEvo: Large Language Models as Hyper-Heuristics with Reflective EvolutionHaoran Ye, Jiarui Wang, Zhiguang Cao, Federico Berto et al.NeurIPS 2024 · 424 citations
- Generalize a Small Pre-trained Model to Arbitrarily Large TSP InstancesZhang-Hua Fu, Kai-Bin Qiu, Hongyuan ZhaAAAI 2021 · 247 citations
Related papers
- Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic DesignZhi Zheng, Zhuoliang Xie, Zhenkun Wang, Bryan HooiICML 2025
- Generalizable Heuristic Generation Through LLMs with Meta-OptimizationYiding Shi, Jianan Zhou, Wen Song, Jieyi Bi et al.ICLR 2026 · 14 citations
- Learn to Relax with Large Language Models: Solving Constraint Optimization Problems via Bidirectional CoevolutionBeidan Liu, Zhengqiu Zhu, Chen Gao, Tianle Pu et al.ACL 2026
- EoH-S: Evolution of Heuristic Set Using LLMs for Automated Heuristic DesignFei Liu, Yilu Liu, Qingfu Zhang, Xialiang Tong et al.AAAI 2026 · 11 citations
- DEPT: Large Language Model–Driven Automated Algorithm Design via Evolutionary Program TreesBin Chen, Shouliang Zhu, Beidan Liu, Yong Zhao et al.ICML 2026 · 3 citations
