Lune

EMNLP Findings2020

Record-to-Text Generation with Style Imitation

Shuai Lin, Wentao Wang, Zichao Yang, Xiaodan Liang, Frank F. Xu, Eric P. Xing, Zhiting Hu

Abstract

Recent neural approaches to data-to-text generation have mostly focused on improving content fidelity while lacking explicit control over writing styles (e.g., word choices, sentence structures). More traditional systems use templates to determine the realization of text. Yet manual or automatic construction of highquality templates is difficult, and a template acting as hard constraints could harm content fidelity when it does not match the record perfectly. We study a new way of stylistic control by using existing sentences as "soft" templates. That is, the model learns to imitate the writing style of any given exemplar sentence, with automatic adaptions to faithfully describe the content record. The problem is challenging due to the lack of parallel data. We develop a neural approach that includes a hybrid attention-copy mechanism, learns with weak supervisions, and is enhanced with a new content coverage constraint. We conduct experiments in restaurants and sports domains. Results show our approach achieves stronger performance than a range of comparison methods. Our approach balances well between content fidelity and style control given exemplars that match the records to varying degrees. 1

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 4 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers4

  1. COLD Decoding: Energy-based Constrained Text Generation with Langevin DynamicsLianhui Qin, Sean Welleck, Daniel Khashabi, Yejin ChoiNeurIPS 2022 · 217 citations
  2. Data-to-text Generation by Splicing Together Nearest NeighborsSam Wiseman, Arturs Backurs, Karl StratosEMNLP 2021 · 9 citations
  3. Expository Text Generation: Imitate, Retrieve, ParaphraseNishant Balepur, Jie Huang, Kevin Chen-Chuan ChangEMNLP 2023 · 6 citations
  4. Text Fact TransferNishant Balepur, Jie Huang, Kevin Chen-Chuan ChangEMNLP 2023

Builds on1

  1. Variational Template Machine for Data-to-Text GenerationRong Ye, Wenxian Shi, Hao Zhou, Zhongyu Wei et al.ICLR 2020 · 45 citations

Related papers

  1. Make Templates Smarter: A Template Based Data2Text System Powered by Text Stitch ModelBingfeng Luo, Zuo Bai, Kunfeng Lai, Jianping ShenEMNLP Findings 2020
  2. Learning to Select Bi-Aspect Information for Document-Scale Text Content ManipulationXiaocheng Feng, Yawei Sun, Bing Qin, Heng Gong et al.AAAI 2020 · 5 citations
  3. Plan-then-Generate: Controlled Data-to-Text Generation via PlanningYixuan Su, David Vandyke, Sihui Wang, Yimai Fang et al.EMNLP Findings 2021 · 65 citations
  4. Masked Based Unsupervised Content TransferRon Mokady, Sagie Benaim, Lior Wolf, Amit BermanoICLR 2020
  5. Style-Specific Neurons for Steering LLMs in Text Style TransferWen Lai, Viktor Hangya, Alexander FraserEMNLP 2024 · 5 citations
Dusk over the sea between two cliffs drawn in fine vertical lines