Lune

ACL Findings2026

Strategy-Induct: Task-Level Strategy Induction for Instruction Generation

Po-Chun Chen, Hen-Hsen Huang, Hsin-Hsi Chen

Abstract

Designing effective task-level prompts is crucial for improving the performance of Large Language Models (LLMs). While prior work on instruction induction demonstrates that LLMs can infer better instructions with limited examples, existing approaches often rely on input-output pairs, where obtaining labeled answers can be difficult or costly. To address this limitation, we propose STRATEGY-INDUCT, a framework that derives task-level instructions solely from a small set of example questions without requiring labeled answers. Our approach first prompts the model to generate explicit reasoning strategies for each question, forming (strategy, question) pairs. These pairs are then used to induce a task instruction that guides reasoning. Experiments across multiple tasks and model scales demonstrate that STRATEGY-INDUCT outperforms state-of-theart methods in question-only settings. Furthermore, we observe that jointly utilizing LLMs and Large Reasoning Models across task instruction generation and inference may lead to further performance improvements.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Large Language Models are Zero-Shot Reasoners cites Language Models are Few-Shot Learners
  • Large Language Models are Zero-Shot Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution cites Large Language Models are Zero-Shot Reasoners
  • Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution cites Language Models are Few-Shot Learners
  • Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution cites Large Language Models are Human-Level Prompt Engineers
  • Large Language Models are Human-Level Prompt Engineers cites Large Language Models are Zero-Shot Reasoners
  • Large Language Models are Human-Level Prompt Engineers cites Language Models are Few-Shot Learners
  • Large Language Models are Human-Level Prompt Engineers cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on22

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  3. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  4. Promptbreeder: Self-Referential Self-Improvement via Prompt EvolutionChrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero et al.ICML 2024 · 432 citations
  5. Large Language Models are Human-Level Prompt EngineersYongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster et al.ICLR 2023 · 297 citations

Related papers

  1. StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem SolvingChang Gao, Haiyun Jiang, Deng Cai, Shuming Shi et al.NeurIPS 2024 · 21 citations
  2. Induct-Learn: Short Phrase Prompting with Instruction InductionPo-Chun Chen, Sheng-Lun Wei, Hen-Hsen Huang, Hsin-Hsi ChenEMNLP 2024 · 1 citation
  3. Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the TextKewei Cheng, Nesreen K. Ahmed, Theodore L. Willke, Yizhou SunEMNLP 2024 · 6 citations
  4. Learning to Plan by Updating Natural LanguageYiduo Guo, Yaobo Liang, Chenfei Wu, Wenshan Wu et al.EMNLP Findings 2024
  5. On the Role of Model Prior in Real-World Inductive ReasoningZhuo Liu, Ding Yu, Hangfeng HeEMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines