Lune

EMNLP Findings2023

Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models

Haoran Wang, Kai Shu

Abstract

Claim verification plays a crucial role in combating misinformation. While existing works on claim verification have shown promising results, a crucial piece of the puzzle that remains unsolved is to understand how to verify claims without relying on human-annotated data, which is expensive to create at a large scale. Additionally, it is important for models to provide comprehensive explanations that can justify their decisions and assist human fact-checkers. This paper presents First-Order-Logic-Guided Knowledge-Grounded (FOLK) Reasoning that can verify complex claims and generate explanations without the need for annotated evidence using Large Language Models (LLMs). FOLK leverages the in-context learning ability of LLMs to translate the claim into a First-Order-Logic (FOL) clause consisting of predicates, each corresponding to a subclaim that needs to be verified. Then, FOLK performs FOL-Guided reasoning over a set of knowledge-grounded question-and-answer pairs to make veracity predictions and generate explanations to justify its decision-making process. This process makes our model highly explanatory, providing clear explanations of its reasoning process in human-readable form. Our experiment results indicate that FOLK outperforms strong baselines on three datasets encompassing various claim verification challenges. Our code and data are available. 1

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

15 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection cites Language Models are Few-Shot Learners
  • What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection cites Training language models to follow instructions with human feedback
  • PAL: Program-aided Language Models cites Language Models are Few-Shot Learners
  • PAL: Program-aided Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models are Zero-Shot Reasoners cites Language Models are Few-Shot Learners
  • Large Language Models are Zero-Shot Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models are Zero-Shot Reasoners cites Training language models to follow instructions with human feedback
  • BiDeV: Bilateral Defusing Verification for Complex Claim Fact-Checking cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • BiDeV: Bilateral Defusing Verification for Complex Claim Fact-Checking cites Training language models to follow instructions with human feedback
  • Chain-of-Thought Prompting Elicits Reasoning in Large Language Models cites Training language models to follow instructions with human feedback
  • Argumentative Large Language Models for Explainable and Contestable Claim Verification cites Language Models are Few-Shot Learners
  • Argumentative Large Language Models for Explainable and Contestable Claim Verification cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers15

  1. Supernotes: Driving Consensus in Crowd-Sourced Fact-CheckingSoham De, Michiel A. Bakker, Jay Baxter, Martin SaveskiWWW 2025 · 31 citations
  2. Argumentative Large Language Models for Explainable and Contestable Claim VerificationGabriel Freedman, Adam Dejl, Deniz Gorur, Xiang Yin et al.AAAI 2025 · 31 citations
  3. What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot DetectionShangbin Feng, Herun Wan, Ningnan Wang, Zhaoxuan Tan et al.ACL 2024 · 19 citations
  4. BiDeV: Bilateral Defusing Verification for Complex Claim Fact-CheckingYuxuan Liu, Hongda Sun, Wenya Guo, Xinyan Xiao et al.AAAI 2025 · 11 citations
  5. MRR-FV: Unlocking Complex Fact Verification with Multi-Hop Retrieval and ReasoningLiwen Zheng, Chaozhuo Li, Litian Zhang, Haoran Jia et al.AAAI 2025 · 6 citations

Builds on22

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  3. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  4. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  5. PAL: Program-aided Language ModelsLuyu Gao, Aman Madaan, Shuyan Zhou, Uri Alon et al.ICML 2023 · 700 citations

Related papers

  1. Fact-Checking Complex Claims with Program-Guided ReasoningLiangming Pan, Xiaobao Wu, Xinyuan Lu, Anh Tuan Luu et al.ACL 2023 · 45 citations
  2. Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language ModelsHan Cao, Lingwei Wei, Wei Zhou, Songlin HuAAAI 2025 · 1 citation
  3. ClaimPKG: Enhancing Claim Verification via Pseudo-Subgraph Generation with Lightweight Specialized LLMHoang Pham, Thanh-Do Nguyen, Khac-Hoai Nam BuiACL Findings 2025
  4. FOLIO: Natural Language Reasoning with First-Order LogicSimeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi et al.EMNLP 2024 · 18 citations
  5. Fact Verification on Knowledge Graph via Programmatic Graph ReasoningYuanzhen Hao, Desheng WuEMNLP Findings 2025
Dusk over the sea between two cliffs drawn in fine vertical lines