Lune

ACL Findings2022

GRS: Combining Generation and Revision in Unsupervised Sentence Simplification

Mohammad Dehghan, Dhruv Kumar, Lukasz Golab

Abstract

We propose GRS: an unsupervised approach to sentence simplification that combines text generation and text revision. We start with an iterative framework in which an input sentence is revised using explicit edit operations, and add paraphrasing as a new edit operation. This allows us to combine the advantages of generative and revision-based approaches: paraphrasing captures complex edit operations, and the use of explicit edit operations in an iterative manner provides controllability and interpretability. We demonstrate these advantages of GRS compared to existing methods on the Newsela and ASSET datasets.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 2 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers2

  1. Optimizing Chinese Lexical Simplification Across Word Types: A Hybrid ApproachZihao Xiao, Jiefu Gong, Shijin Wang, Wei SongEMNLP 2024 · 1 citation
  2. GradEscape: A Gradient-Based Evader Against AI-Generated Text DetectorsWenlong Meng, Shuguo Fan, Chengkun Wei, Min Chen et al.USENIX Security 2025

Builds on8

  1. Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
  2. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
  3. Neural CRF Model for Sentence Alignment in Text SimplificationChao Jiang, Mounica Maddela, Wuwei Lan, Yang Zhong et al.ACL 2020 · 103 citations
  4. Iterative Edit-Based Unsupervised Sentence SimplificationDhruv Kumar, Lili Mou, Lukasz Golab, Olga VechtomovaACL 2020 · 58 citations
  5. LEWIS: Levenshtein Editing for Unsupervised Text Style TransferMachel Reid, Victor ZhongACL Findings 2021 · 47 citations

Related papers

  1. Text Revision By On-the-Fly Representation OptimizationJingjing Li, Zichao Li, Tao Ge, Irwin King et al.AAAI 2022 · 20 citations
  2. A Non-Autoregressive Edit-Based Approach to Controllable Text SimplificationSweta Agrawal, Weijia Xu, Marine CarpuatACL Findings 2021 · 23 citations
  3. Edit-Constrained Decoding for Sentence SimplificationTatsuya Zetsu, Yuki Arase, Tomoyuki KajiwaraEMNLP Findings 2024
  4. Improving Iterative Text Revision by Learning Where to Edit from Other Revision TasksZae Myung Kim, Wanyu Du, Vipul Raheja, Dhruv Kumar et al.EMNLP 2022 · 8 citations
  5. Keep It Simple: Unsupervised Simplification of Multi-Paragraph TextPhilippe Laban, Tobias Schnabel, Paul N. Bennett, Marti A. HearstACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines