ACL Findings2022
GRS: Combining Generation and Revision in Unsupervised Sentence Simplification
Mohammad Dehghan, Dhruv Kumar, Lukasz Golab
Abstract
We propose GRS: an unsupervised approach to sentence simplification that combines text generation and text revision. We start with an iterative framework in which an input sentence is revised using explicit edit operations, and add paraphrasing as a new edit operation. This allows us to combine the advantages of generative and revision-based approaches: paraphrasing captures complex edit operations, and the use of explicit edit operations in an iterative manner provides controllability and interpretability. We demonstrate these advantages of GRS compared to existing methods on the Newsela and ASSET datasets.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 2 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers2
Builds on8
- Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Neural CRF Model for Sentence Alignment in Text SimplificationChao Jiang, Mounica Maddela, Wuwei Lan, Yang Zhong et al.ACL 2020 · 103 citations
- Iterative Edit-Based Unsupervised Sentence SimplificationDhruv Kumar, Lili Mou, Lukasz Golab, Olga VechtomovaACL 2020 · 58 citations
- LEWIS: Levenshtein Editing for Unsupervised Text Style TransferMachel Reid, Victor ZhongACL Findings 2021 · 47 citations
Related papers
- Text Revision By On-the-Fly Representation OptimizationJingjing Li, Zichao Li, Tao Ge, Irwin King et al.AAAI 2022 · 20 citations
- A Non-Autoregressive Edit-Based Approach to Controllable Text SimplificationSweta Agrawal, Weijia Xu, Marine CarpuatACL Findings 2021 · 23 citations
- Edit-Constrained Decoding for Sentence SimplificationTatsuya Zetsu, Yuki Arase, Tomoyuki KajiwaraEMNLP Findings 2024
- Improving Iterative Text Revision by Learning Where to Edit from Other Revision TasksZae Myung Kim, Wanyu Du, Vipul Raheja, Dhruv Kumar et al.EMNLP 2022 · 8 citations
- Keep It Simple: Unsupervised Simplification of Multi-Paragraph TextPhilippe Laban, Tobias Schnabel, Paul N. Bennett, Marti A. HearstACL 2021
