Lune

AAAI2025顶会

CROSSNEWS: A Cross-Genre Authorship Verification and Attribution Benchmark

Marcus Ma, Duong Minh Le, Junmo Kang, Yao Dou, John Cadigan, Dayne Freitag, Alan Ritter, Wei Xu

摘要

Authorship models have historically generalized poorly to new domains because of the wide distribution of author-identifying signals across domains. In particular, the effects of topic and genre are highly domain-dependent and impact authorship analysis performance greatly. This paper addresses the existing data gap in authorship for these resources by introducing CROSSNEWS, a novel cross-genre dataset that connects formal journalistic articles and casual social media posts. CROSSNEWS is the largest authorship dataset of its kind for supporting both verification and attribution tasks, with comprehensive topic and genre annotations. We use CROSSNEWS to demonstrate that current models exhibit poor performance in genre transfer scenarios, underscoring the need for authorship models robust to genre-specific effects. We also explore SELMA, a new LLM embedding approach for large-scale authorship setups that outperforms existing models in both same-genre and cross-genre settings.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper4

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 等NeurIPS 2022 · 22,562 次引用
  2. Can Large Language Models Identify Authorship?Baixiang Huang, Canyu Chen, Kai ShuEMNLP Findings 2024 · 30 次引用
  3. Who Wrote it and Why? Prompting Large-Language Models for Authorship VerificationChia-Yu Hung, Zhiqiang Hu, Yujia Hu, Roy Ka-Wei LeeEMNLP Findings 2023 · 10 次引用
  4. Improving Text Embeddings with Large Language ModelsLiang Wang, Nan Yang, Xiaolong Huang, Linjun Yang 等ACL 2024

相关 Paper

  1. The Million Authors Corpus: A Cross-Lingual and Cross-Domain Wikipedia Dataset for Authorship VerificationAbraham Israeli, Shuai Liu, Jonathan May, David JurgensACL Findings 2025
  2. The Topic Confusion Task: A Novel Evaluation Scenario for Authorship AttributionMalik H. Altakrori, Jackie Chi Kit Cheung, Benjamin C. M. FungEMNLP Findings 2021 · 11 次引用
  3. Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social MediaShubham Mittal, Megha Sundriyal, Preslav NakovEMNLP 2023 · 4 次引用
  4. A Bayesian Approach to Harnessing the Power of LLMs in Authorship AttributionZhengmian Hu, Tong Zheng, Heng HuangEMNLP 2024 · 1 次引用
  5. STANDER: An Expert-Annotated Dataset for News Stance Detection and Evidence RetrievalCostanza Conforti, Jakob Berndt, Mohammad Taher Pilehvar, Chryssi Giannitsarou 等EMNLP Findings 2020 · 12 次引用
黄昏的海面,两侧是细线勾勒的悬崖