Lune

EMNLP Findings2023

CReTIHC: Designing Causal Reasoning Tasks about Temporal Interventions and Hallucinated Confoundings

Changwoo Chun, Songeun Lee, Jaehyung Seo, Heuiseok Lim

Abstract

Large language models (LLMs) have demonstrated impressive capabilities in natural language processing.However, their ability to establish causal relationships, particularly in the context of temporal interventions and language hallucinations, remains challenging.This paper presents CReTIHC, a novel dataset designed to test and enhance the causal reasoning abilities of LLMs.The dataset is constructed using a unique approach that incorporates elements of verbal hallucinations and temporal interventions through the reengineering of existing causal inference datasets.This transformation creates complex scenarios that push LLMs to critically evaluate the information presented and identify cause-and-effect relationships.The CReTIHC dataset serves as a pioneering tool for improving LLM's causal inference capabilities, paving the way for a more nuanced understanding of causal relationships in natural language processing (NLP) tasks.The whole dataset is publicly accessible at: (https://github.com/ChangwooChun/CReTIHC)

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. COLD: Causal reasOning in cLosed Daily activitiesAbhinav Joshi, Areeb Ahmad, Ashutosh ModiNeurIPS 2024 · 11 citations

Builds on5

  1. Self-Refine: Iterative Refinement with Self-FeedbackAman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan et al.NeurIPS 2023 · 4,972 citations
  2. ROCK: Causal Inference Principles for Reasoning about Commonsense CausalityJiayao Zhang, Hongming Zhang, Weijie J. Su, Dan RothICML 2022 · 28 citations
  3. Improving Commonsense Causal Reasoning by Adversarial Training and Data AugmentationIeva Staliunaite, Philip John Gorinski, Ignacio IacobacciAAAI 2021 · 23 citations
  4. Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal EstimatesKatherine A. Keith, David D. Jensen, Brendan O'ConnorACL 2020 · 16 citations
  5. e-CARE: a New Dataset for Exploring Explainable Causal ReasoningLi Du, Xiao Ding, Kai Xiong, Ting Liu et al.ACL 2022

Related papers

  1. ExpliCa: Evaluating Explicit Causal Reasoning in Large Language ModelsMartina Miliani, Serena Auriemma, Alessandro Bondielli, Emmanuele Chersoni et al.ACL Findings 2025 · 4 citations
  2. Mitigating Hallucinations in Large Language Models via Causal ReasoningYuangang Li, Yiqing Shen, Yi Nian, Jiechao Gao et al.AAAI 2026 · 1 citation
  3. Can Large Language Models Infer Causation from Correlation?Zhijing Jin, Jiarui Liu, Zhiheng Lyu, Spencer Poff et al.ICLR 2024 · 186 citations
  4. Generating Effective CoT Traces for Mitigating Causal HallucinationYiheng Zhao, Jun YanACL Findings 2026
  5. CounterBench: Evaluating and Improving Counterfactual Reasoning in Large Language ModelsYuefei Chen, Vivek K. Singh, Jing Ma, Ruixiang TangAAAI 2026 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines