Partition to Evolve: Niching-enhanced Evolution with LLMs for Automated Algorithm Discovery
Qinglong Hu, Qingfu Zhang
Abstract
Large language model-assisted Evolutionary Search (LES) has emerged as a promising approach for Automated Algorithm Discovery (AAD). While many evolutionary search strategies have been developed for classic optimization problems, LES operates in abstract language spaces, presenting unique challenges for applying these strategies effectively. To address this, we propose a general LES framework that incorporates feature-assisted niche construction within abstract search spaces, enabling the seamless integration of niche-based search strategies from evolutionary computation. Building on this framework, we introduce PartEvo (Partition to Evolve), an LES method that combines niche collaborative search and advanced prompting strategies to improve algorithm discovery efficiency. Experiments on both synthetic and real-world optimization problems show that PartEvo outperforms human-designed baselines and surpasses prior LES methods. In particular, on resource scheduling tasks, PartEvo generates meta-heuristics with low design costs, achieving up to 90.1% performance improvement over widely-used baseline algorithms, highlighting its potential for real-world applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f3ba0001-f3b4-4a25-b3cc-e900f90c0e14Cited by top-tier papers2
- RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional ExperienceYang Wu, Junran Pan, Yifan Zhang, Ning Xu et al.ICML 2026
- Hierarchical Representations for Cross-task Automated Heuristic Design using LLMsFei Liu, Rui Zhang, Shunyu Yao, Qinglong Hu et al.ICML 2026
Builds on16
- WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex InstructionsCan Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng et al.ICLR 2024 · 1,206 citations
- Large Language Models as OptimizersChengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu et al.ICLR 2024 · 817 citations
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon et al.NeurIPS 2020 · 731 citations
- Eureka: Human-Level Reward Design via Coding Large Language ModelsYecheng Jason Ma, William Liang, Guanzhi Wang, De-An Huang et al.ICLR 2024 · 582 citations
- ReEvo: Large Language Models as Hyper-Heuristics with Reflective EvolutionHaoran Ye, Jiarui Wang, Zhiguang Cao, Federico Berto et al.NeurIPS 2024 · 424 citations
Related papers
- Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language ModelFei Liu, Xialiang Tong, Mingxuan Yuan, Xi Lin et al.ICML 2024 · 238 citations
- DEPT: Large Language Model–Driven Automated Algorithm Design via Evolutionary Program TreesBin Chen, Shouliang Zhu, Beidan Liu, Yong Zhao et al.ICML 2026 · 3 citations
- HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMsPham Vu Tuan Dat, Long Doan, Huynh Thi Thanh BinhAAAI 2025 · 3 citations
- HiFo-Prompt: Prompting with Hindsight and Foresight for LLM-based Automatic Heuristic DesignChentongChen, Mengyuan Zhong, Jialong Shi, Jianyong Sun et al.ICLR 2026 · 17 citations
- Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial OptimizationHa Minh Hieu, Hung Phan, Tung Duy Doan, Tung Dao et al.AAAI 2026 · 2 citations
