Lune

EMNLP Findings2023

CReTIHC: Designing Causal Reasoning Tasks about Temporal Interventions and Hallucinated Confoundings

Changwoo Chun, Songeun Lee, Jaehyung Seo, Heuiseok Lim

摘要

Large language models (LLMs) have demonstrated impressive capabilities in natural language processing.However, their ability to establish causal relationships, particularly in the context of temporal interventions and language hallucinations, remains challenging.This paper presents CReTIHC, a novel dataset designed to test and enhance the causal reasoning abilities of LLMs.The dataset is constructed using a unique approach that incorporates elements of verbal hallucinations and temporal interventions through the reengineering of existing causal inference datasets.This transformation creates complex scenarios that push LLMs to critically evaluate the information presented and identify cause-and-effect relationships.The CReTIHC dataset serves as a pioneering tool for improving LLM's causal inference capabilities, paving the way for a more nuanced understanding of causal relationships in natural language processing (NLP) tasks.The whole dataset is publicly accessible at: (https://github.com/ChangwooChun/CReTIHC)

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 引用它的 1 篇顶会 Paper · 相关的 Paper

获取答案

免费开始,无需绑卡

引用它的顶会 Paper1

  1. COLD: Causal reasOning in cLosed Daily activitiesAbhinav Joshi, Areeb Ahmad, Ashutosh ModiNeurIPS 2024 · 11 次引用

它引用的 Paper5

  1. Self-Refine: Iterative Refinement with Self-FeedbackAman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan 等NeurIPS 2023 · 4,972 次引用
  2. ROCK: Causal Inference Principles for Reasoning about Commonsense CausalityJiayao Zhang, Hongming Zhang, Weijie J. Su, Dan RothICML 2022 · 28 次引用
  3. Improving Commonsense Causal Reasoning by Adversarial Training and Data AugmentationIeva Staliunaite, Philip John Gorinski, Ignacio IacobacciAAAI 2021 · 23 次引用
  4. Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal EstimatesKatherine A. Keith, David D. Jensen, Brendan O'ConnorACL 2020 · 16 次引用
  5. e-CARE: a New Dataset for Exploring Explainable Causal ReasoningLi Du, Xiao Ding, Kai Xiong, Ting Liu 等ACL 2022

相关 Paper

  1. ExpliCa: Evaluating Explicit Causal Reasoning in Large Language ModelsMartina Miliani, Serena Auriemma, Alessandro Bondielli, Emmanuele Chersoni 等ACL Findings 2025 · 4 次引用
  2. Mitigating Hallucinations in Large Language Models via Causal ReasoningYuangang Li, Yiqing Shen, Yi Nian, Jiechao Gao 等AAAI 2026 · 1 次引用
  3. Can Large Language Models Infer Causation from Correlation?Zhijing Jin, Jiarui Liu, Zhiheng Lyu, Spencer Poff 等ICLR 2024 · 186 次引用
  4. Generating Effective CoT Traces for Mitigating Causal HallucinationYiheng Zhao, Jun YanACL Findings 2026
  5. CounterBench: Evaluating and Improving Counterfactual Reasoning in Large Language ModelsYuefei Chen, Vivek K. Singh, Jing Ma, Ruixiang TangAAAI 2026 · 1 次引用
黄昏的海面,两侧是细线勾勒的悬崖