Lune

ACL Findings2024

Prompt-Based Length Controlled Generation with Multiple Control Types

Renlong Jie, Xiaojun Meng, Lifeng Shang, Xin Jiang, Qun Liu

Abstract

Large language models (LLMs) have attracted great attention given their strong performance on a wide range of NLP tasks. In practice, users often expect generated texts to fall within a specific length range, making length controlled generation an important topic, especially for GPT-style models. Existing length control methods mostly focus on a simple control type of "equal to" a target length. Different from them, we propose a prompt-based method to achieve length controlled generation under different control types with high accuracy. In particular, we adopt reinforcement learning (RL) and sample filtering with the reward signal given by rule-based reward models, which enhances the length control ability of models by rewarding outputs that follow certain control instructions. In addition, we introduce a standard prompt extractor to parse arbitrary users' input into standard control instructions. Experiments show that our method significantly improves the accuracy of prompt-based length control on popular summarization datasets like CNNDM and NYT under multiple control types. Moreover, both the standard prompt extractor and RL-tuned model show strong generalization to unseen control prompt templates.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

6 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • LARFT: Closing the Cognition-Action Gap for Length Instruction Following in Large Language Models cites Length Controlled Generation for Black-box LLMs
  • LARFT: Closing the Cognition-Action Gap for Length Instruction Following in Large Language Models cites Language Models are Few-Shot Learners
  • LARFT: Closing the Cognition-Action Gap for Length Instruction Following in Large Language Models cites Training language models to follow instructions with human feedback
  • Length Controlled Generation for Black-box LLMs cites BERTScore: Evaluating Text Generation with BERT
  • Length Controlled Generation for Black-box LLMs cites Language Models are Few-Shot Learners
  • Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers6

  1. CEC-Zero: Zero-Supervision Character Error Correction with Self-Generated RewardsZhiming Lin, Kai Zhao, Sophie Zhang, Peilai Yu et al.AAAI 2026 · 11 citations
  2. Sprout: Green Generative AI with Carbon-Efficient LLM InferenceBaolin Li, Yankai Jiang, Vijay Gadepally, Devesh TiwariEMNLP 2024 · 11 citations
  3. Strategic Planning and Rationalizing on Trees Make LLMs Better DebatersDanqing Wang, Zhuorui Ye, Xinran Zhao, Fei Fang et al.ICLR 2026 · 2 citations
  4. LARFT: Closing the Cognition-Action Gap for Length Instruction Following in Large Language ModelsWei Zhang, Lintong Du, yuanhe zhang, Zhenhong Zhou et al.ICML 2026
  5. Length Controlled Generation for Black-box LLMsYuxuan Gu, Wenjie Wang, Xiaocheng Feng, Weihong Zhong et al.ACL 2025

Builds on10

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  3. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
  4. ERNIE 2.0: A Continual Pre-Training Framework for Language UnderstandingYu Sun, Shuohuan Wang, Yu-Kun Li, Shikun Feng et al.AAAI 2020 · 885 citations
  5. Asking Questions the Human Way: Scalable Question-Answer Generation from Text CorpusBang Liu, Haojie Wei, Di Niu, Haolan Chen et al.WWW 2020 · 100 citations

Related papers

  1. DcLM: Output Length Control of Large Language Models via Dynamic Length MarkersZhe Chen, Jiaao Yu, Honglin LiACL Findings 2026
  2. Ruler: A Model-Agnostic Method to Control Generated Length for Large Language ModelsJiaming Li, Lei Zhang, Yunshui Li, Ziqiang Liu et al.EMNLP Findings 2024 · 1 citation
  3. Hansel: Output Length Controlling Framework for Large Language ModelsSeoha Song, Junhyun Lee, Hyeonmok KoAAAI 2025 · 2 citations
  4. From General Reward to Targeted Reward: Improving Open-ended Long-context Generation ModelsZhihan Guo, Jiele Wu, Wenqian Cui, Yifei Zhang et al.EMNLP 2025
  5. Teaching Models to Improve on TapeLiat Bezalel, Eyal Orgad, Amir GlobersonAAAI 2025
Dusk over the sea between two cliffs drawn in fine vertical lines