AutoEP: LLMs-Driven Automation of Hyperparameter Evolution for Metaheuristic Algorithms
Zhenxing Xu, Yizhe Zhang, Weidong Bao, Hao Wang, Ming Chen, Haoran Ye, Wenzheng Jiang, Hui Yan, Ji Wang
摘要
Dynamically configuring algorithm hyperparameters is a fundamental challenge in computational intelligence. While learning-based methods offer automation, they suffer from prohibitive sample complexity and poor generalization. We introduce AutoEP, a novel framework that bypasses training entirely by leveraging Large Language Models (LLMs) as zero-shot reasoning engines for algorithm control. AutoEP's core innovation lies in a tight synergy between two components: (1) an online Exploratory Landscape Analysis (ELA) module that provides real-time, quantitative feedback on the search dynamics, and (2) a multi-LLM reasoning chain that interprets this feedback to generate adaptive hyperparameter strategies. This approach grounds high-level reasoning in empirical data, mitigating hallucination. Evaluated on three distinct metaheuristics across diverse combinatorial optimization benchmarks, AutoEP consistently outperforms state-of-the-art tuners, including neural evolution and other LLM-based methods. Notably, our framework enables open-source models like Qwen3-30B to match the performance of GPT-4, demonstrating a powerful and accessible new paradigm for automated hyperparameter design.Our code is available at https://anonymous.4open.science/r/AutoEP-3E11.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Meta Context Engineering via Agentic Skill EvolutionHaoran Ye, Xuning He, Vincent Arak, Haonan Dong 等ICML 2026 · 被引用 30 次
- Hierarchical Representations for Cross-task Automated Heuristic Design using LLMsFei Liu, Rui Zhang, Shunyu Yao, Qinglong Hu 等ICML 2026
它引用的顶会 Paper11
- HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FaceYongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li 等NeurIPS 2023 · 被引用 1,778 次
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le 等ICLR 2023 · 被引用 681 次
- Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale GeneralizationFu Luo, Xi Lin, Fei Liu, Qingfu Zhang 等NeurIPS 2023 · 被引用 248 次
- Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language ModelFei Liu, Xialiang Tong, Mingxuan Yuan, Xi Lin 等ICML 2024 · 被引用 238 次
- Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative TransformerYining Ma, Jingwen Li, Zhiguang Cao, Wen Song 等NeurIPS 2021 · 被引用 230 次
相关 Paper
- HiFo-Prompt: Prompting with Hindsight and Foresight for LLM-based Automatic Heuristic DesignChentongChen, Mengyuan Zhong, Jialong Shi, Jianyong Sun 等ICLR 2026 · 被引用 17 次
- ReEvo: Large Language Models as Hyper-Heuristics with Reflective EvolutionHaoran Ye, Jiarui Wang, Zhiguang Cao, Federico Berto 等NeurIPS 2024 · 被引用 424 次
- Generalizable Heuristic Generation Through LLMs with Meta-OptimizationYiding Shi, Jianan Zhou, Wen Song, Jieyi Bi 等ICLR 2026 · 被引用 14 次
- Large Language Models to Enhance Bayesian OptimizationTennison Liu, Nicolás Astorga, Nabeel Seedat, Mihaela van der SchaarICLR 2024 · 被引用 143 次
- Game-Theoretic Co-Evolution for LLM-Based Heuristic DiscoveryXinyi Ke, Kai Li, Junliang Xing, Yifan Zhang 等ICML 2026 · 被引用 1 次
