Lune

ACL Findings2025

Heuristic-based Search Algorithm in Automatic Instruction-focused Prompt Optimization: A Survey

Wendi Cui, Jiaxin Zhang, Zhuohang Li, Hao Sun, Damien Lopez, Kamalika Das, Bradley A. Malin, Kumar Sricharan

Abstract

Recent advances in Large Language Models (LLMs) have led to remarkable achievements, making prompt engineering increasingly central to guiding model outputs.While manual methods (e.g., "chain-of-thought," "step-bystep" prompts) can be effective, they typically rely on intuition and do not automatically refine prompts.In contrast, automatic prompt optimization employing heuristic-based search algorithms can systematically explore and improve prompts with minimal human oversight.This survey proposes a comprehensive taxonomy of these methods, categorizing them by where optimization occurs, what is optimized, what criteria drive the optimization, which operators generate new prompts, and which iterative search algorithms are applied.We further highlight specialized datasets and tools that support and accelerate automated prompt refinement.We conclude by discussing key open challenges for future opportunities for more robust and versatile LLM applications.* The corresponding GitHub repository for this paper will be updated at https://github.com/jxzhangjhu/ Awesome-LLM-Prompt-Optimization.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional Experience cites Reflexion: language agents with verbal reinforcement learning
  • Reflexion: language agents with verbal reinforcement learning cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models are Zero-Shot Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models as Optimizers cites Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery
  • Large Language Models as Optimizers cites Large Language Models are Zero-Shot Reasoners
  • Large Language Models as Optimizers cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional ExperienceYang Wu, Junran Pan, Yifan Zhang, Ning Xu et al.ICML 2026

Builds on42

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  3. Reflexion: language agents with verbal reinforcement learningNoah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan et al.NeurIPS 2023 · 5,828 citations
  4. Large Language Models as OptimizersChengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu et al.ICLR 2024 · 817 citations
  5. Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and DiscoveryYuxin Wen, Neel Jain, John Kirchenbauer, Micah Goldblum et al.NeurIPS 2023 · 454 citations

Related papers

  1. A Systematic Survey of Automatic Prompt Optimization TechniquesKiran Ramnath, Kang Zhou, Sheng Guan, Soumya Smruti Mishra et al.EMNLP 2025 · 5 citations
  2. PRompt Optimization in Multi-Step Tasks (PROMST): Integrating Human Feedback and Heuristic-based SamplingYongchao Chen, Jacob Arkin, Yilun Hao, Yang Zhang et al.EMNLP 2024 · 6 citations
  3. HPSS: Heuristic Prompting Strategy Search for LLM EvaluatorsBosi Wen, Pei Ke, Yufei Sun, Cunxiang Wang et al.ACL Findings 2025 · 3 citations
  4. PromptWizard: Optimizing Prompts via Task-Aware, Feedback-Driven Self-EvolutionEshaan Agarwal, Raghav Magazine, Joykirat Singh, Vivek Dani et al.ACL Findings 2025 · 2 citations
  5. AMPO: Automatic Multi-Branched Prompt OptimizationSheng Yang, Yurong Wu, Yan Gao, Zineng Zhou et al.EMNLP 2024 · 5 citations
Dusk over the sea between two cliffs drawn in fine vertical lines