Lune

ACL Findings2022

CaM-Gen: Causally Aware Metric-Guided Text Generation

Navita Goyal, Roodram Paneri, Ayush Agarwal, Udit Kalani, Abhilasha Sancheti, Niyati Chhaya

Abstract

Content is created for a well-defined purpose, often described by a metric or signal represented in the form of structured information. The relationship between the goal (metrics) of target content and the content itself is nontrivial. While large-scale language models show promising text generation capabilities, guiding the generated text with external metrics is challenging. These metrics and content tend to have inherent relationships and not all of them may be of consequence. We introduce CaM-Gen: Causally aware Generative Networks guided by user-defined target metrics incorporating the causal relationships between the metric and content features. We leverage causal inference techniques to identify causally significant aspects of a text that lead to the target metric and then explicitly guide generative models towards these by a feedback mechanism. We propose this mechanism for variational autoencoder and Transformer-based generative models. The proposed models beat baselines in terms of the target metric control while maintaining fluency and language quality of the generated text. To the best of our knowledge, this is one of the early attempts at controlled generation incorporating a metric guide using causal inference.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. Debiasing Recommendation with Personal PopularityWentao Ning, Reynold Cheng, Xiao Yan, Ben Kao et al.WWW 2024 · 26 citations
  2. Causality-aware Concept Extraction based on Knowledge-guided PromptingSiyu Yuan, Deqing Yang, Jinxi Liu, Shuyu Tian et al.ACL 2023 · 7 citations

Builds on2

  1. BLEURT: Learning Robust Metrics for Text GenerationThibault Sellam, Dipanjan Das, Ankur P. ParikhACL 2020 · 40 citations
  2. Incorporating Stylistic Lexical Preferences in Generative Language ModelsHrituraj Singh, Gaurav Verma, Balaji Vasan SrinivasanEMNLP Findings 2020 · 3 citations

Related papers

  1. Causality-Aided Evaluation and Explanation of Large Language Model-Based Code GenerationZhenlan Ji, Pingchuan Ma, Zongjie Li, Zhaoyu Wang et al.ISSTA 2025 · 1 citation
  2. iTAG: Inverse Design for Natural Text Generation with Accurate Causal Graph AnnotationsWenshuo Wang, Boyu Cao, Nan Zhuang, Wei LiACL 2026
  3. CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal KnowledgeLei Zan, Keli Zhang, Ruichu Cai, Lujia PanAAAI 2026
  4. Fine-Grained Controllable Text Generation Using Non-Residual PromptingFredrik Carlsson, Joey Öhman, Fangyu Liu, Severine Verlinden et al.ACL 2022
  5. Learning to Disentangle Latent Reasoning Rules with Language VAEs: A Systematic StudyYingji Zhang, Marco Valentino, Danilo S. Carvalho, André FreitasAAAI 2026 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines