EMNLP Findings2020
Temporal Reasoning in Natural Language Inference
Siddharth Vashishtha, Adam Poliak, Yash Kumar Lal, Benjamin Van Durme, Aaron Steven White
Abstract
We introduce five new natural language inference (NLI) datasets focused on temporal reasoning. We recast four existing datasets annotated for event duration-how long an event lasts-and event ordering-how events are temporally arranged-into more than one million NLI examples. We use these datasets to investigate how well neural models trained on a popular NLI corpus capture these forms of temporal reasoning.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 14 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers14
- ROCK: Causal Inference Principles for Reasoning about Commonsense CausalityJiayao Zhang, Hongming Zhang, Weijie J. Su, Dan RothICML 2022 · 28 citations
- IndoNLI: A Natural Language Inference Dataset for IndonesianRahmad Mahendra, Alham Fikri Aji, Samuel Louvan, Fahrurrozi Rahman et al.EMNLP 2021 · 14 citations
- A Dataset for Hyper-Relational Extraction and a Cube-Filling ApproachYew Ken Chia, Lidong Bing, Sharifah Mahani Aljunied, Luo Si et al.EMNLP 2022 · 11 citations
- Adjective Scale Probe: Can Language Models Encode Formal Semantics Information?Wei Liu, Ming Xiang, Nai DingAAAI 2023 · 7 citations
- Temporal reasoning for timeline summarisation in social mediaJiayu Song, Mahmud Elahi Akhter, Dana Atzil-Slonim, Maria LiakataACL 2025 · 6 citations
Builds on3
- TORQUE: A Reading Comprehension Dataset of Temporal Ordering QuestionsQiang Ning, Hao Wu, Rujun Han, Nanyun Peng et al.EMNLP 2020 · 79 citations
- Temporal Common Sense Acquisition with Minimal SupervisionBen Zhou, Qiang Ning, Daniel Khashabi, Dan RothACL 2020 · 76 citations
- Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionPaloma Jeretic, Alex Warstadt, Suvrat Bhooshan, Adina WilliamsACL 2020 · 2 citations
Related papers
- Do Language Models Have a Common Sense regarding Time? Revisiting Temporal Commonsense Reasoning in the Era of Large Language ModelsRaghav Jain, Daivik Sojitra, Arkadeep Acharya, Sriparna Saha et al.EMNLP 2023 · 17 citations
- Test of Time: A Benchmark for Evaluating LLMs on Temporal ReasoningBahare Fatemi, Mehran Kazemi, Anton Tsitsulin, Karishma Malkan et al.ICLR 2025 · 2 citations
- ETRQA: A Comprehensive Benchmark for Evaluating Event Temporal Reasoning Abilities of Large Language ModelsSigang Luo, Yinan Liu, Dongying Lin, Yingying Zhai et al.ACL Findings 2025 · 3 citations
- LexTime: A Benchmark for Temporal Ordering of Legal EventsClaire Barale, Leslie Barrett, Vikram Sunil Bajaj, Michael RovatsosEMNLP Findings 2025 · 2 citations
- TIMEDIAL: Temporal Commonsense Reasoning in DialogLianhui Qin, Aditya Gupta, Shyam Upadhyay, Luheng He et al.ACL 2021
