EMNLP Findings2025
Who's the Author? How Explanations Impact User Reliance in AI-Assisted Authorship Attribution
Calvin Bao, Connor Baumler, Hal Daumé III, Marine Carpuat
Abstract
Despite growing interest in explainable NLP, it remains unclear how explanation strategies shape user behavior in tasks like authorship identification, where relevant textual features may be difficult for lay users to pinpoint. To support their analysis of text style, we consider two explanation types: example-based style rewrites and feature-based rationales, generated using a LLM-based pipeline. We measured how explanations impact user behavior in a controlled study (n=95) where participants completed authorship identification tasks with our types of assistance. While no explanation type improved overall task accuracy, fine-grained reliance patterns (Schemmer et al., 2023) revealed that rewrites supported appropriate reliance, whereas presenting both explanation types increased AI overreliance, minimizing participant self-reliance. We find that participants exhibiting better reliance behaviors had focused explanation needs, contrasting with the diffused preferences of those who overrelied on AI, or incorrectly self-relied. These findings highlight the need for adaptive explanation systems that tailor support based on specific user reliance behaviors.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
- Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations cites Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
- Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations cites Explanations Can Reduce Overreliance on AI Systems During Decision-Making
- Explanations Can Reduce Overreliance on AI Systems During Decision-Making cites Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
- Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making cites Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Builds on16
- Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team PerformanceGagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok et al.CHI 2021 · 713 citations
- Explanations Can Reduce Overreliance on AI Systems During Decision-MakingHelena Vasconcelos, Matthew Jörke, Madeleine Grunde-McLaughlin, Tobias Gerstenberg et al.CSCW 2023 · 362 citations
- Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with ExplanationsValerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan BansalCSCW 2023 · 146 citations
- Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision MakingMin Hun Lee, Chong Jun ChewCSCW 2023 · 74 citations
- Cognitive Bias in Decision-Making with LLMsJessica Maria Echterhoff, Yao Liu, Abeer Alessa, Julian J. McAuley et al.EMNLP Findings 2024 · 62 citations
Related papers
- Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and InconsistenciesSunnie S. Y. Kim, Jennifer Wortman Vaughan, Q. Vera Liao, Tania Lombrozo et al.CHI 2025 · 118 citations
- Authorship Drift: How Self-Efficacy and Trust Evolve During LLM-Assisted WritingYeon Su Park, Nadia Azzahra Putri Arvi, Seoyoung Kim, Juho KimCHI 2026 · 3 citations
- Behavioral Indicators of Overreliance During Interaction with Conversational Language ModelsChang Liu, Qinyi Zhou, Xinjie Shen, Xingyu Bruce Liu et al.CHI 2026 · 4 citations
- Do Expressions Change Decisions? Exploring the Impact of AI's Explanation Tone on Decision-MakingAyano Okoso, Mingzhe Yang, Yukino BabaCHI 2025 · 18 citations
- Is It Still You? Attributing Authorship and Authenticity in AI-Assisted Romantic CommunicationGuangrui Fan, Dandan Liu, Lihu PanCHI 2026 · 2 citations
