Lune

ACL Findings2025

FanChuan: A Multilingual and Graph-Structured Benchmark For Parody Detection and Analysis

Yilun Zheng, Sha Li, Fangkun Wu, Yang Ziyi, Lin Hongchao, Zhichao Hu, Cai Xinjun, Ziming Wang, Jinxuan Chen, Sitao Luan, Jiahao Xu, Lihui Chen

Abstract

Parody is an emerging phenomenon on social media, where individuals imitate a role or position opposite to their own, often for humor, provocation, or controversy. Detecting and analyzing parody can be challenging and is often reliant on context, yet it plays a crucial role in understanding cultural values, promoting subcultures, and enhancing self-expression. However, the study of parody is hindered by limited available data and deficient diversity in current datasets. To bridge this gap, we built seven parody datasets from both English and Chinese corpora, with 14,755 annotated users and 21,210 annotated comments in total. To provide sufficient context information, we also collect replies and construct user-interaction graphs to provide richer contextual information, which is lacking in existing datasets. With these datasets, we test traditional methods and Large Language Models (LLMs) on three key tasks: (1) parody detection, (2) comment sentiment analysis with parody, and (3) user sentiment analysis with parody. Our extensive experiments reveal that parody-related tasks still remain challenging for all models, and contextual information plays a critical role. Interestingly, we find that, in certain scenarios, traditional sentence embedding methods combined with simple classifiers can outperform advanced LLMs, e.g., DeepSeek-R1 and GPT-o3, highlighting parody as a significant challenge for LLMs. Our code and data is available at https: //github.com/Lisaaa1017/Fanchuan.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on5

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. A Multitask Framework for Sentiment, Emotion and Sarcasm aware Cyberbullying Detection from Multi-modal Code-Mixed MemesKrishanu Maity, Prince Jha, Sriparna Saha, Pushpak BhattacharyyaSIGIR 2022 · 80 citations
  3. Is Sarcasm Detection a Step-by-Step Reasoning Process in Large Language Models?Ben Yao, Yazhou Zhang, Qiuchi Li, Jing QinAAAI 2025 · 29 citations
  4. EPIC: Multi-Perspective Annotation of a Corpus of IronySimona Frenda, Alessandro Pedrani, Valerio Basile, Soda Marem Lo et al.ACL 2023 · 9 citations
  5. Analyzing Political Parody in Social MediaAntonis Maronikolakis, Danae Sanchez Villegas, Daniel Preotiuc-Pietro, Nikolaos AletrasACL 2020 · 3 citations

Related papers

  1. MultiPICo: Multilingual Perspectivist Irony CorpusSilvia Casola, Simona Frenda, Soda Marem Lo, Erhan Sezerer et al.ACL 2024 · 2 citations
  2. Improving Large-scale Paraphrase Acquisition and GenerationYao Dou, Chao Jiang, Wei XuEMNLP 2022 · 11 citations
  3. I'm sure you're a real scholar yourself: Exploring Ironic Content Generation by Large Language ModelsPier Felice Balestrucci, Silvia Casola, Soda Marem Lo, Valerio Basile et al.EMNLP Findings 2024 · 1 citation
  4. Just Like a Human Would, Direct Access to Sarcasm Augmented with Potential Result and ReactionChangrong Min, Ximing Li, Liang Yang, Zhilin Wang et al.ACL 2023 · 12 citations
  5. Impact of Stickers on Multimodal Sentiment and Intent in Social Media: A New Task, Dataset and BaselineYuanchen Shi, Fang Kong, Longyin ZhangACM MM 2025 · 3 citations
Dusk over the sea between two cliffs drawn in fine vertical lines