Lune

EMNLP Findings2024

Can Large Language Models Identify Authorship?

Baixiang Huang, Canyu Chen, Kai Shu

Abstract

The ability to accurately identify authorship is crucial for verifying content authenticity and mitigating misinformation. Large Language Models (LLMs) have demonstrated an exceptional capacity for reasoning and problemsolving. However, their potential in authorship analysis remains under-explored. Traditional studies have depended on hand-crafted stylistic features, whereas state-of-the-art approaches leverage text embeddings from pre-trained language models. These methods, which typically require fine-tuning on labeled data, often suffer from performance degradation in cross-domain applications and provide limited explainability. This work seeks to address three research questions: (1) Can LLMs perform zero-shot, end-toend authorship verification effectively? (2) Are LLMs capable of accurately attributing authorship among multiple candidates authors (e.g., 10 and 20)? (3) Can LLMs provide explainability in authorship analysis, particularly through the role of linguistic features? Moreover, we investigate the integration of explicit linguistic features to guide LLMs in their reasoning processes. Our assessment demonstrates LLMs' proficiency in both tasks without the need for domain-specific fine-tuning, providing explanations into their decision making via a detailed analysis of linguistic features. This establishes a new benchmark for future research on LLMbased authorship analysis 1 .

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 7 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers7

  1. Can Editing LLMs Inject Harm?Canyu Chen, Baixiang Huang, Zekun Li, Zhaorun Chen et al.AAAI 2026 · 26 citations
  2. Vid2Coach: Transforming How-To Videos into Task AssistantsMina Huh, Zihui Xue, Ujjaini Das, Kumar Ashutosh et al.UIST 2025 · 9 citations
  3. CROSSNEWS: A Cross-Genre Authorship Verification and Attribution BenchmarkMarcus Ma, Duong Minh Le, Junmo Kang, Yao Dou et al.AAAI 2025 · 3 citations
  4. Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-MakingYuanjun Feng, Vivek Choudhary, Yash Raj ShresthaEMNLP 2025 · 2 citations
  5. Robust Native Language Identification through Agentic DecompositionAhmet Yavuz Uluslu, Tannon Kew, Tilia Ellendorff, Gerold Schneider et al.EMNLP 2025 · 1 citation

Builds on8

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  3. Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
  4. ELECTRA: Pre-training Text Encoders as Discriminators Rather Than GeneratorsKevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. ManningICLR 2020 · 541 citations
  5. Authorship Attribution for Neural Text GenerationAdaku Uchendu, Thai Le, Kai Shu, Dongwon LeeEMNLP 2020 · 110 citations

Related papers

  1. A Bayesian Approach to Harnessing the Power of LLMs in Authorship AttributionZhengmian Hu, Tong Zheng, Heng HuangEMNLP 2024 · 1 citation
  2. The Two Paradigms of LLM Detection: Authorship Attribution vs Authorship VerificationJanek Bevendorff, Matti Wiegmann, Emmelie Richter, Martin Potthast et al.ACL Findings 2025 · 6 citations
  3. Who Wrote it and Why? Prompting Large-Language Models for Authorship VerificationChia-Yu Hung, Zhiqiang Hu, Yujia Hu, Roy Ka-Wei LeeEMNLP Findings 2023 · 10 citations
  4. Open-World Authorship AttributionXinhao Tan, Songhua Liu, Xia Cong, Kunjun Li et al.ACL Findings 2025
  5. Unraveling Interwoven Roles of Large Language Models in Authorship Privacy: Obfuscation, Mimicking, and VerificationTuc Nguyen, Yifan Hu, Thai LeEMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines