EMNLP Findings2023
Time-Aware Representation Learning for Time-Sensitive Question Answering
Jungbin Son, Alice Oh
Abstract
Time is one of the crucial factors in real-world question answering (QA) problems. However, language models have difficulty understanding the relationships between time specifiers, such as 'after' and 'before', and numbers, since existing QA datasets do not include sufficient time expressions. To address this issue, we propose a Time-Context aware Question Answering (TCQA) framework. We suggest a Time-Context dependent Span Extraction (TCSE) task, and build a time-context dependent data generation framework for model training. Moreover, we present a metric to evaluate the time awareness of the QA model using TCSE. The TCSE task consists of a question and four sentence candidates classified as correct or incorrect based on time and context. The model is trained to extract the answer span from the sentence that is both correct in time and context. The model trained with TCQA outperforms baseline models up to 8.5 of the F1-score in the TimeQA dataset. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
3 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Improving Time Sensitivity for Question Answering over Temporal Knowledge Graphs cites Question Answering Over Temporal Knowledge Graphs
- It's High Time: A Survey of Temporal Question Answering cites TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models
- It's High Time: A Survey of Temporal Question Answering cites Question Answering Over Temporal Knowledge Graphs
- It's High Time: A Survey of Temporal Question Answering cites TimeR⁴ : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering
- TimeR⁴ : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering cites ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
- TimeR⁴ : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering cites Question Answering Over Temporal Knowledge Graphs
Cited by top-tier papers3
- TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language ModelsZheng Chu, Jingchang Chen, Qianglong Chen, Weijiang Yu et al.ACL 2024 · 12 citations
- TimeR⁴ : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question AnsweringXinying Qian, Ying Zhang, Yu Zhao, Baohang Zhou et al.EMNLP 2024 · 11 citations
- It's High Time: A Survey of Temporal Question AnsweringBhawna Piryani, Abdelrahman Abdallah, Jamshid Mozafari, Avishek Anand et al.ACL 2026 · 6 citations
Builds on5
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie et al.NeurIPS 2020 · 3,159 citations
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than GeneratorsKevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. ManningICLR 2020 · 541 citations
- Improving Time Sensitivity for Question Answering over Temporal Knowledge GraphsChao Shang, Guangtao Wang, Peng Qi, Jing HuangACL 2022 · 55 citations
- Question Answering Over Temporal Knowledge GraphsApoorv Saxena, Soumen Chakrabarti, Partha P. TalukdarACL 2021
Related papers
- UnSeenTimeQA: Time-Sensitive Question-Answering Beyond LLMs' MemorizationMd Nayem Uddin, Amir Saeidi, Divij Handa, Agastya Seth et al.ACL 2025 · 18 citations
- Enhancing Temporal Sensitivity and Reasoning for Time-Sensitive Question AnsweringWanqi Yang, Yanda Li, Meng Fang, Ling ChenEMNLP Findings 2024 · 4 citations
- Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in LLMsSoyeon Kim, Jindong Wang, Xing Xie, Steven Euijong WhangICLR 2026
- Once Upon a Time in Graph: Relative-Time Pretraining for Complex Temporal ReasoningSen Yang, Xin Li, Lidong Bing, Wai LamEMNLP 2023 · 1 citation
- Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language ModelsQingyu Tan, Hwee Tou Ng, Lidong BingACL 2023 · 24 citations
