Lune

EMNLP Findings2024

How Entangled is Factuality and Deception in German?

Aswathy Velutharambath, Amelie Wührl, Roman Klinger

Abstract

The statement "The earth is flat" is factually inaccurate, but if someone truly believes and argues in its favor, it is not deceptive. Research on deception detection and fact checking often conflates factual accuracy with the truthfulness of statements. This assumption makes it difficult to (a) study subtle distinctions and interactions between the two and (b) gauge their effects on downstream tasks. The belief-based deception framework disentangles these properties by defining texts as deceptive when there is a mismatch between what people say and what they truly believe. In this study, we assess if presumed patterns of deception generalize to German language texts. We test the effectiveness of computational models in detecting deception using an established corpus of belief-based argumentation. Finally, we gauge the impact of deception on the downstream task of fact checking and explore if this property confounds verification models. Surprisingly, our analysis finds no correlation with established cues of deception. Previous work claimed that computational models can outperform humans in deception detection accuracy, however, our experiments show that both traditional and state-of-the-art models struggle with the task, performing no better than random guessing. For fact checking, we find that natural language inference-based verification performs worse on non-factual and deceptive content, while prompting large language models for the same task is less sensitive to these properties.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on3

  1. Synthetic Disinformation Attacks on Automated Fact Verification SystemsYibing Du, Antoine Bosselut, Christopher D. ManningAAAI 2022 · 58 citations
  2. It Takes Two to Lie: One to Lie, and One to ListenDenis Peskov, Benny Cheng, Ahmed Elgohary, Joe Barrow et al.ACL 2020 · 28 citations
  3. Scientific Fact-Checking: A Survey of Resources and ApproachesJuraj Vladika, Florian MatthesACL Findings 2023 · 20 citations

Related papers

  1. Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign PromptsZhaomin Wu, Mingzhe Du, See-Kiong Ng, Bingsheng HeICLR 2026 · 11 citations
  2. Hidden in Plain Sight: Evaluation of the Deception Detection Capabilities of LLMs in Multimodal SettingsMd Messal Monem Miah, Adrita Anika, Xi Shi, Ruihong HuangACL 2025
  3. LH-DECEPTION: Simulating and Understanding LLM Deceptive Behaviors in Long-Horizon InteractionsYang Xu, Xuanming Zhang, Samuel (Min-Hsuan) Yeh, Jwala Dhamala et al.ICLR 2026 · 7 citations
  4. FakeWorld 1.0: An Omni-modal Benchmark for Fake Media and ContentYifeng Gao, Yifan Ding, Li Wang, Feida Huang et al.ICML 2026
  5. "Does it Matter When I Think You Are Lying?" Improving Deception Detection by Integrating Interlocutor's Judgements in ConversationsHuang-Cheng Chou, Woan-Shiuan Chien, Da-Cheng Juan, Chi-Chun LeeACL Findings 2021 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines