EMNLP Findings2020
Record-to-Text Generation with Style Imitation
Shuai Lin, Wentao Wang, Zichao Yang, Xiaodan Liang, Frank F. Xu, Eric P. Xing, Zhiting Hu
Abstract
Recent neural approaches to data-to-text generation have mostly focused on improving content fidelity while lacking explicit control over writing styles (e.g., word choices, sentence structures). More traditional systems use templates to determine the realization of text. Yet manual or automatic construction of highquality templates is difficult, and a template acting as hard constraints could harm content fidelity when it does not match the record perfectly. We study a new way of stylistic control by using existing sentences as "soft" templates. That is, the model learns to imitate the writing style of any given exemplar sentence, with automatic adaptions to faithfully describe the content record. The problem is challenging due to the lack of parallel data. We develop a neural approach that includes a hybrid attention-copy mechanism, learns with weak supervisions, and is enhanced with a new content coverage constraint. We conduct experiments in restaurants and sports domains. Results show our approach achieves stronger performance than a range of comparison methods. Our approach balances well between content fidelity and style control given exemplars that match the records to varying degrees. 1
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 4 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers4
- COLD Decoding: Energy-based Constrained Text Generation with Langevin DynamicsLianhui Qin, Sean Welleck, Daniel Khashabi, Yejin ChoiNeurIPS 2022 · 217 citations
- Data-to-text Generation by Splicing Together Nearest NeighborsSam Wiseman, Arturs Backurs, Karl StratosEMNLP 2021 · 9 citations
- Expository Text Generation: Imitate, Retrieve, ParaphraseNishant Balepur, Jie Huang, Kevin Chen-Chuan ChangEMNLP 2023 · 6 citations
- Text Fact TransferNishant Balepur, Jie Huang, Kevin Chen-Chuan ChangEMNLP 2023
Builds on1
Related papers
- Make Templates Smarter: A Template Based Data2Text System Powered by Text Stitch ModelBingfeng Luo, Zuo Bai, Kunfeng Lai, Jianping ShenEMNLP Findings 2020
- Learning to Select Bi-Aspect Information for Document-Scale Text Content ManipulationXiaocheng Feng, Yawei Sun, Bing Qin, Heng Gong et al.AAAI 2020 · 5 citations
- Plan-then-Generate: Controlled Data-to-Text Generation via PlanningYixuan Su, David Vandyke, Sihui Wang, Yimai Fang et al.EMNLP Findings 2021 · 65 citations
- Masked Based Unsupervised Content TransferRon Mokady, Sagie Benaim, Lior Wolf, Amit BermanoICLR 2020
- Style-Specific Neurons for Steering LLMs in Text Style TransferWen Lai, Viktor Hangya, Alexander FraserEMNLP 2024 · 5 citations
