Lune

EMNLP Findings2025

Quantifying the Risks of LLM- and Tool-assisted Rephrasing to Linguistic Diversity

Mengying Wang, Andreas Spitz

Abstract

Writing assistants and large language models see widespread use in the creation of text content. While their effectiveness for individual users has been evaluated in the literature, little is known about their proclivity to change language or reduce its richness when adopted by a large user base. In this paper, we take a first step towards quantifying this risk by measuring the semantic and vocabulary change enacted by the use of rephrasing tools on a multi-domain corpus of human-generated text.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on2

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
  2. CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model CapabilitiesMina Lee, Percy Liang, Qian YangCHI 2022 · 340 citations

Related papers

  1. The Impact of Large Language Models in Academia: from Writing to SpeakingMingmeng Geng, Caixi Chen, Yanru Wu, Yao Wan et al.ACL Findings 2025 · 7 citations
  2. Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal StyleConnor Baumler, Calvin Bao, Huy Nghiem, Xinchen Yang et al.ACL 2026 · 1 citation
  3. NAP2: A Benchmark for Naturalness and Privacy-Preserving Text Rewriting by Learning from HumanShuo Huang, William MacLean, Xiaoxi Kang, Qiongkai Xu et al.EMNLP Findings 2025
  4. Mind the Style Gap: Meta-Evaluation of Style and Attribute Transfer MetricsAmalie Brogaard Pauli, Isabelle Augenstein, Ira AssentEMNLP Findings 2025
  5. Does Writing with Language Models Reduce Content Diversity?Vishakh Padmakumar, He HeICLR 2024 · 173 citations
Dusk over the sea between two cliffs drawn in fine vertical lines