TransPL: VQ-Code Transition Matrices for Pseudo-Labeling of Time Series Unsupervised Domain Adaptation
Jaeho Kim, Seulki Lee
Abstract
Unsupervised domain adaptation (UDA) for time series data remains a critical challenge in deep learning, with traditional pseudo-labeling strategies failing to capture temporal patterns and channel-wise shifts between domains, producing sub-optimal pseudo labels. As such, we introduce TransPL, a novel approach that addresses these limitations by modeling the joint distribution P(X, y) of the source domain through code transition matrices, where the codes are derived from vector quantization (VQ) of time series patches. Our method constructs class-and channel-wise code transition matrices from the source domain and employs Bayes' rule for target domain adaptation, generating pseudo-labels based on channel-wise weighted class-conditional likelihoods. TransPL offers three key advantages: explicit modeling of temporal transitions and channel-wise shifts between different domains, versatility towards different UDA scenarios (e.g. weakly-supervised UDA), and explainable pseudo-label generation. We validate TransPL's effectiveness through extensive analysis on four time series UDA benchmarks and confirm that it consistently outperforms state-of-theart pseudo-labeling methods by a strong margin (6.1% accuracy improvement, 4.9% F1 improvement), while providing interpretable insights into the domain adaptation process through its learned code transition matrices.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9e5aa604-7564-4190-b830-cbe9f4f02651Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain AdaptationJian Liang, Dapeng Hu, Jiashi FengICML 2020 · 1,624 citations
- Vector-quantized Image Modeling with Improved VQGANJiahui Yu, Xin Li, Jing Yu Koh, Han Zhang et al.ICLR 2022 · 753 citations
- Unsupervised Domain Adaptation via Structured Prediction Based Selective Pseudo-LabelingQian Wang, Toby P. BreckonAAAI 2020 · 257 citations
- Domain Adaptation for Time Series Under Feature and Label ShiftsHuan He, Owen Queen, Teddy Koker, Consuelo Cuevas et al.ICML 2023 · 121 citations
- Time Series Domain Adaptation via Sparse Associative Structure AlignmentRuichu Cai, Jiawei Chen, Zijian Li, Wei Chen et al.AAAI 2021 · 116 citations
Related papers
- Abstracted Shapes as Tokens - A Generalizable and Interpretable Model for Time-series ClassificationYunshi Wen, Tengfei Ma, Lily Weng, Lam M. Nguyen et al.NeurIPS 2024 · 20 citations
- CDTrans: Cross-domain Transformer for Unsupervised Domain AdaptationTongkun Xu, Weihua Chen, Pichao Wang, Fan Wang et al.ICLR 2022 · 293 citations
- Source-Free Domain Adaptation with Temporal Imputation for Time Series DataMohamed Ragab, Emadeldeen Eldele, Min Wu, Chuan-Sheng Foo et al.KDD 2023 · 17 citations
- Adversarial-Learned Loss for Domain AdaptationMinghao Chen, Shuai Zhao, Haifeng Liu, Deng CaiAAAI 2020 · 195 citations
- Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor DataGarrett Wilson, Janardhan Rao Doppa, Diane J. CookKDD 2020 · 6 citations
