ROCK: Causal Inference Principles for Reasoning about Commonsense Causality
Jiayao Zhang, Hongming Zhang, Weijie J. Su, Dan Roth
Abstract
Commonsense causality reasoning (CCR) aims at identifying plausible causes and effects in natural language descriptions that are deemed reasonable by an average person. Although being of great academic and practical interest, this problem is still shadowed by the lack of a wellposed theoretical framework; existing work usually relies on deep language models wholeheartedly, and is potentially susceptible to confounding co-occurrences. Motivated by classical causal principles, we articulate the central question of CCR and draw parallels between human subjects in observational studies and natural languages to adopt CCR to the potential-outcomes framework which, to the best of our knowledge, is the first such attempt for commonsense tasks. We propose a novel framework, ROCK, to Reason O(A)bout Commonsense K(C)ausality, which utilizes temporal signals as incidental supervision, and balances confounding effects using temporal propensities that are analogous to propensity scores. ROCK is modular and zero-shot, and demonstrates good CCR capabilities.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ea4ef8db-4575-43c9-8d6b-1777cd0de3e3Cited by top-tier papers8
- Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical ConstraintsJiaxin Bai, Xin Liu, Weiqi Wang, Chen Luo et al.NeurIPS 2023 · 46 citations
- COLD: Causal reasOning in cLosed Daily activitiesAbhinav Joshi, Areeb Ahmad, Ashutosh ModiNeurIPS 2024 · 11 citations
- A Causal Explainable Guardrails for Large Language ModelsZhixuan Chu, Yan Wang, Longfei Li, Zhibo Wang et al.CCS 2024 · 5 citations
- Event Causality Identification with Synthetic ControlHaoyu Wang, Fengze Liu, Jiayao Zhang, Dan Roth et al.EMNLP 2024 · 3 citations
- The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge ReasoningShaobo Cui, Zhijing Jin, Bernhard Schölkopf, Boi FaltingsEMNLP 2024 · 2 citations
Builds on6
- Finetuned Language Models are Zero-Shot LearnersJason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu et al.ICLR 2022 · 4,966 citations
- Temporal Common Sense Acquisition with Minimal SupervisionBen Zhou, Qiang Ning, Daniel Khashabi, Dan RothACL 2020 · 76 citations
- Pre-training Is (Almost) All You Need: An Application to Commonsense ReasoningAlexandre Tamborrino, Nicola Pellicanò, Baptiste Pannier, Pascal Voitot et al.ACL 2020 · 30 citations
- Unsupervised Commonsense Question Answering with Self-TalkVered Shwartz, Peter West, Ronan Le Bras, Chandra Bhagavatula et al.EMNLP 2020 · 25 citations
- Improving Commonsense Causal Reasoning by Adversarial Training and Data AugmentationIeva Staliunaite, Philip John Gorinski, Ignacio IacobacciAAAI 2021 · 23 citations
Related papers
- COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference PerspectiveZhaowei Wang, Quyet V. Do, Hongming Zhang, Jiayao Zhang et al.ACL 2023 · 8 citations
- Abductive Commonsense Reasoning Exploiting Mutually Exclusive ExplanationsWenting Zhao, Justin T. Chiu, Claire Cardie, Alexander M. RushACL 2023 · 3 citations
- Conversational Multi-Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic RulesForough Arabshahi, Jennifer Lee, Antoine Bosselut, Yejin Choi et al.EMNLP 2021 · 10 citations
- Compositional Causal Reasoning Evaluation in Language ModelsJacqueline R. M. A. Maasch, Alihan Hüyük, Xinnuo Xu, Aditya V. Nori et al.ICML 2025
- Language Agents Meet Causality - Bridging LLMs and Causal World ModelsJohn Gkountouras, Matthias Lindemann, Phillip Lippe, Efstratios Gavves et al.ICLR 2025
