Lune

CHI2021Top-tier venue

"I Can't Reply with That": Characterizing Problematic Email Reply Suggestions

Ronald E. Robertson, Alexandra Olteanu, Fernando Diaz, Milad Shokouhi, Peter Bailey

Abstract

Supervisor I sent you a link to my presentation. What did you think about it? Got it! Looking forward to it! Sweet as! LOL It was amazing! Good for you! No worries! It was terrible

In email interfaces, providing users with reply suggestions may simplify or accelerate correspondence. While the "success" of such systems is typically quantified using the number of suggestions selected by users, this ignores the impact of social context, which can change how suggestions are perceived. To address this, we developed a mixed-methods framework involving qualitative interviews and crowdsourced experiments to characterize problematic email reply suggestions. Our interviews revealed issues with over-positive, dissonant, cultural, and gender-assuming replies, as well as contextual politeness. In our experiments, crowdworkers assessed email scenarios that we generated and systematically controlled, showing that contextual factors like social ties and the presence of salutations impacts users' perceptions of email correspondence. These assessments created a novel dataset of human-authored corrections for problematic email replies. Our study highlights the social complexity of providing suggestions for email correspondence, raising issues that may apply to all social messaging systems.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

12 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process cites Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
  • Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process cites A Design Space for Intelligent and Interactive Writing Assistants
  • Helping the Helper : Supporting Peer Counselors via AI-Empowered Practice and Feedback cites Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
  • A Design Space for Intelligent and Interactive Writing Assistants cites Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
  • 'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models cites Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers12

  1. A Design Space for Intelligent and Interactive Writing AssistantsMina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum et al.CHI 2024 · 133 citations
  2. Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email WritingYihe Liu, Anushk Mittal, Diyi Yang, Amy S. BruckmanCHI 2022 · 86 citations
  3. 'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language ModelsAngel Hsing-Chi Hwang, Q. Vera Liao, Su Lin Blodgett, Alexandra Olteanu et al.CSCW 2025 · 36 citations
  4. Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing ProcessMohi Reza, Jeb Thomas-Mitchell, Peter Dushniku, Nathan Laundry et al.CSCW 2025 · 29 citations
  5. Helping the Helper : Supporting Peer Counselors via AI-Empowered Practice and FeedbackShang-Ling Hsu, Raj Sanjay Shah, Prathik Senthil, Zahra Ashktorab et al.CSCW 2025 · 20 citations

Builds on2

  1. Social Comparison and Facebook: Feedback, Positivity, and Opportunities for ComparisonMoira Burke, Justin Cheng, Bethany de GantCHI 2020 · 59 citations
  2. When Are Search Completion Suggestions Problematic?Alexandra Olteanu, Fernando Diaz, Gabriella KazaiCSCW 2020 · 38 citations

Related papers

  1. "Hi Alex" or "Dear Dr. Morgan"?: Exploring How AI-suggested Politeness Strategies Influence Email Writing and Social Perception Among Native and Non-native SpeakersZibo Selena Zhang, Yuna Choi, Ziang Xiao, Q. Vera Liao et al.CSCW 2026
  2. Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated CommunicationLiye Fu, Benjamin Newman, Maurice Jakesch, Sarah KrepsCHI 2023 · 28 citations
  3. Understanding and Supporting Formal Email Exchange by Answering AI-Generated QuestionsYusuke Miura, Chi-Lan Yang, Masaki Kuribayashi, Keigo Matsumoto et al.CHI 2025 · 4 citations
  4. AI-Mediated Communication: Language Use and Interpersonal Effects in a Referential Communication TaskHannah Mieczkowski, Jeffrey T. Hancock, Mor Naaman, Malte F. Jung et al.CSCW 2021 · 83 citations
  5. A Dataset and Baselines for Multilingual Reply SuggestionMozhi Zhang, Wei Wang, Budhaditya Deb, Guoqing Zheng et al.ACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines