Knowledge-driven Augmentation and Retrieval for Integrative Temporal Adaptation
Weisi Liu, Guangzeng Han, Xiaolei Huang
Abstract
Time introduces fundamental challenges in model development and deployment: models are usually trained on historical data while deployed on future data where semantic distributions and domain knowledge may evolve. Unfortunately, existing studies either overlook temporal shifts or hardly capture rich shifting patterns of both semantic and knowledge. We develop Knowledge-driven Augmentation and Retrieval for Integrative Temporal Adaptation (KARITA) to capture diverse temporal shifts (e.g., uncertainty and feature shift), construct and integrate rich knowledge sources (e.g., medical ontology like MeSH), and leverage shifting insights for selecting-retrieval augmented learning. We evaluate KARITA on classification tasks across multiple domains, clinical, legal, and scientific corpora, demonstrating consistent improvements across multiple domains with temporal adaptation. Our results show that knowledge integration can be more critical and effective in temporal augmentation and learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8939f409-0d0b-4dc4-990d-7bd009db9880Builds on12
- Tent: Fully Test-Time Adaptation by Entropy MinimizationDequan Wang, Evan Shelhamer, Shaoteng Liu, Bruno A. Olshausen et al.ICLR 2021 · 1,731 citations
- Efficient Test-Time Model Adaptation without ForgettingShuaicheng Niu, Jiaxiang Wu, Yifan Zhang, Yaofo Chen et al.ICML 2022 · 579 citations
- Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
- Towards Continual Knowledge Learning of Language ModelsJoel Jang, Seonghyeon Ye, Sohee Yang, Joongbo Shin et al.ICLR 2022 · 204 citations
- MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transferIlias Chalkidis, Manos Fergadiotis, Ion AndroutsopoulosEMNLP 2021 · 78 citations
Related papers
- Retrieval-Augmented Language Model for Knowledge-aware Protein EncodingJiasheng Zhang, Delvin Ce Zhang, Shuang Liang, Zhengpin Li et al.ICML 2025
- TAdaRAG: Task Adaptive Retrieval-Augmented Generation via On-the-Fly Knowledge Graph ConstructionJie Zhang, Bo Tang, Wanzi Shao, Wenqiang Wei et al.AAAI 2026
- RA-TTA: Retrieval-Augmented Test-Time Adaptation for Vision-Language ModelsYoungjun Lee, Doyoung Kim, Junhyeok Kang, Jihwan Bang et al.ICLR 2025
- Beyond Entropy: Region Confidence Proxy for Wild Test-Time AdaptationZixuan Hu, Yichun Hu, Xiaotong Li, Shixiang Tang et al.ICML 2025
- Mitigating Structural Knowledge Collapse in Domain-Specific LLMs via Morpheme-Aware KV-AggregationYuxuan Si, Zheqi Lv, Chengxi Zang, Zhengyu Chen et al.ACL 2026
