Lune

EMNLP Findings2020

Temporal Reasoning in Natural Language Inference

Siddharth Vashishtha, Adam Poliak, Yash Kumar Lal, Benjamin Van Durme, Aaron Steven White

Abstract

We introduce five new natural language inference (NLI) datasets focused on temporal reasoning. We recast four existing datasets annotated for event duration-how long an event lasts-and event ordering-how events are temporally arranged-into more than one million NLI examples. We use these datasets to investigate how well neural models trained on a popular NLI corpus capture these forms of temporal reasoning.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 14 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers14

  1. ROCK: Causal Inference Principles for Reasoning about Commonsense CausalityJiayao Zhang, Hongming Zhang, Weijie J. Su, Dan RothICML 2022 · 28 citations
  2. IndoNLI: A Natural Language Inference Dataset for IndonesianRahmad Mahendra, Alham Fikri Aji, Samuel Louvan, Fahrurrozi Rahman et al.EMNLP 2021 · 14 citations
  3. A Dataset for Hyper-Relational Extraction and a Cube-Filling ApproachYew Ken Chia, Lidong Bing, Sharifah Mahani Aljunied, Luo Si et al.EMNLP 2022 · 11 citations
  4. Adjective Scale Probe: Can Language Models Encode Formal Semantics Information?Wei Liu, Ming Xiang, Nai DingAAAI 2023 · 7 citations
  5. Temporal reasoning for timeline summarisation in social mediaJiayu Song, Mahmud Elahi Akhter, Dana Atzil-Slonim, Maria LiakataACL 2025 · 6 citations

Builds on3

  1. TORQUE: A Reading Comprehension Dataset of Temporal Ordering QuestionsQiang Ning, Hao Wu, Rujun Han, Nanyun Peng et al.EMNLP 2020 · 79 citations
  2. Temporal Common Sense Acquisition with Minimal SupervisionBen Zhou, Qiang Ning, Daniel Khashabi, Dan RothACL 2020 · 76 citations
  3. Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionPaloma Jeretic, Alex Warstadt, Suvrat Bhooshan, Adina WilliamsACL 2020 · 2 citations

Related papers

  1. Do Language Models Have a Common Sense regarding Time? Revisiting Temporal Commonsense Reasoning in the Era of Large Language ModelsRaghav Jain, Daivik Sojitra, Arkadeep Acharya, Sriparna Saha et al.EMNLP 2023 · 17 citations
  2. Test of Time: A Benchmark for Evaluating LLMs on Temporal ReasoningBahare Fatemi, Mehran Kazemi, Anton Tsitsulin, Karishma Malkan et al.ICLR 2025 · 2 citations
  3. ETRQA: A Comprehensive Benchmark for Evaluating Event Temporal Reasoning Abilities of Large Language ModelsSigang Luo, Yinan Liu, Dongying Lin, Yingying Zhai et al.ACL Findings 2025 · 3 citations
  4. LexTime: A Benchmark for Temporal Ordering of Legal EventsClaire Barale, Leslie Barrett, Vikram Sunil Bajaj, Michael RovatsosEMNLP Findings 2025 · 2 citations
  5. TIMEDIAL: Temporal Commonsense Reasoning in DialogLianhui Qin, Aditya Gupta, Shyam Upadhyay, Luheng He et al.ACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines