Lune

ACL Findings2021

A Non-Autoregressive Edit-Based Approach to Controllable Text Simplification

Sweta Agrawal, Weijia Xu, Marine Carpuat

Abstract

We introduce a new approach for the task of Controllable Text Simplification, where systems rewrite a complex English sentence so that it can be understood by readers at different grade levels in the US K-12 system. It uses a non-autoregressive model to iteratively edit an input sequence and incorporates lexical complexity information seamlessly into the refinement process to generate simplifications that better match the desired output complexity than strong autoregressive baselines. Analysis shows that our model's local edit operations are combined to achieve more complex simplification operations such as content deletion and paraphrasing, as well as sentence splitting.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 9 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers9

  1. CEFR-Based Sentence Difficulty Annotation and AssessmentYuki Arase, Satoru Uchida, Tomoyuki KajiwaraEMNLP 2022 · 17 citations
  2. Improving Iterative Text Revision by Learning Where to Edit from Other Revision TasksZae Myung Kim, Wanyu Du, Vipul Raheja, Dhruv Kumar et al.EMNLP 2022 · 8 citations
  3. Controlling Pre-trained Language Models for Grade-Specific Text SimplificationSweta Agrawal, Marine CarpuatEMNLP 2023 · 5 citations
  4. Linguistic Corpus Annotation for Automatic Text Simplification EvaluationRémi Cardon, Adrien Bibal, Rodrigo Wilkens, David Alfter et al.EMNLP 2022 · 5 citations
  5. SWiPE: A Dataset for Document-Level Simplification of Wikipedia PagesPhilippe Laban, Jesse Vig, Wojciech Kryscinski, Shafiq Joty et al.ACL 2023 · 5 citations

Builds on6

  1. Imputer: Sequence Modelling via Imputation and Dynamic ProgrammingWilliam Chan, Chitwan Saharia, Geoffrey E. Hinton, Mohammad Norouzi et al.ICML 2020 · 127 citations
  2. Neural CRF Model for Sentence Alignment in Text SimplificationChao Jiang, Mounica Maddela, Wuwei Lan, Yang Zhong et al.ACL 2020 · 103 citations
  3. FELIX: Flexible Text Editing Through Tagging and InsertionJonathan Mallinson, Aliaksei Severyn, Eric Malmi, Guillermo GarridoEMNLP Findings 2020 · 59 citations
  4. Iterative Edit-Based Unsupervised Sentence SimplificationDhruv Kumar, Lili Mou, Lukasz Golab, Olga VechtomovaACL 2020 · 58 citations
  5. Automatic Text Simplification Tools for Deaf and Hard of Hearing Adults: Benefits of Lexical Simplification and Providing Users with AutonomyOliver Alonzo, Matthew Seita, Abraham Glasser, Matt HuenerfauthCHI 2020 · 43 citations

Related papers

  1. GRS: Combining Generation and Revision in Unsupervised Sentence SimplificationMohammad Dehghan, Dhruv Kumar, Lukasz GolabACL Findings 2022 · 10 citations
  2. An Imitation Learning Curriculum for Text Editing with Non-Autoregressive ModelsSweta Agrawal, Marine CarpuatACL 2022
  3. Edit-Constrained Decoding for Sentence SimplificationTatsuya Zetsu, Yuki Arase, Tomoyuki KajiwaraEMNLP Findings 2024
  4. ExpertEase: A Multi-Agent Framework for Grade-Specific Document Simplification with Large Language ModelsKaijie Mo, Renfen HuEMNLP Findings 2024 · 4 citations
  5. Discourse Level Factors for Sentence Deletion in Text SimplificationYang Zhong, Chao Jiang, Wei Xu, Junyi Jessy LiAAAI 2020 · 57 citations
Dusk over the sea between two cliffs drawn in fine vertical lines