Enhancing Multivariate Time-Series Domain Adaptation via Contrastive Frequency Graph Discovery and Language-Guided Adversary Alignment
Haoren Guo, Haiyue Zhu, Jiahui Wang, Prahlad Vadakkepat, Weng Khuen Ho, Tong Heng Lee
Abstract
Unsupervised domain adaptation (UDA) is a machine learning approach designed to minimize reliance on labeled data by aligning features between a labeled source domain and an unlabeled target domain, thereby reducing feature discrepancies, which is efficient for multivariate time series (MTS) prediction. However, most MTS UDA methods focus solely on aligning intra-series temporal features, overlooking the valuable information in inter-series dependencies. Research has highlighted that analyzing decomposed frequency dependencies in time series can reveal significant trends, noise patterns, and intricate temporal details. To address these unexplored frequency dependencies, we introduce the Frequency Graph Discovery Module (FGD), which uncovers and aligns shared frequency information and correlations across domains. Additionally, we propose a Frequency-Contextual Contrastive Learning (FCCL) framework to better capture and align frequency-contextual representations in multivariate time series, ensuring the extraction of label-invariant information for prediction. Furthermore, considering existing models overlooking the valuable and abundant information outside source and target dataset, we enhance the MTS UDA prediction model with a Language-guided Adversary Alignment (LAA) module, which leverages the advancement and capabilities of Large Language Models (LLMs) to get text-encoded labeled embeddings and align the classification features, thereby improving prediction accuracy. Our model achieves state-of-the-art results on three public multivariate time-series datasets for unsupervised domain adaptation, as demonstrated by empirical evidence.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 98f2f6d5-80a0-4997-a6a7-16fcb5042846Builds on17
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency ConsistencyXiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, Marinka ZitnikNeurIPS 2022 · 558 citations
- Unsupervised Representation Learning for Time Series with Temporal Neighborhood CodingSana Tonekaboni, Danny Eytan, Anna GoldenbergICLR 2021 · 386 citations
- HoMM: Higher-Order Moment Matching for Unsupervised Domain AdaptationChao Chen, Zhihang Fu, Zhihong Chen, Sheng Jin et al.AAAI 2020 · 254 citations
Related papers
- Contrastive Learning for Unsupervised Domain Adaptation of Time SeriesYilmazcan Özyurt, Stefan Feuerriegel, Ce ZhangICLR 2023 · 25 citations
- MF-CLR: Multi-Frequency Contrastive Learning Representation for Time SeriesJufang Duan, Wei Zheng, Yangzhou Du, Wenfa Wu et al.ICML 2024 · 14 citations
- Boosting Transferability and Discriminability for Time Series Domain AdaptationMingyang Liu, Xinyang Chen, Yang Shu, Xiucheng Li et al.NeurIPS 2024 · 18 citations
- SEnsor Alignment for Multivariate Time-Series Unsupervised Domain AdaptationYucheng Wang, Yuecong Xu, Jianfei Yang, Zhenghua Chen et al.AAAI 2023 · 30 citations
- FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series ClassificationTian Tian, Chunyan Miao, Hangwei QianKDD 2025 · 4 citations
