TACIT: A Target-Agnostic Feature Disentanglement Framework for Cross-Domain Text Classification
Rui Song, Fausto Giunchiglia, Yingji Li, Mingjie Tian, Hao Xu
Abstract
Cross-domain text classification aims to transfer models from label-rich source domains to label-poor target domains, giving it a wide range of practical applications. Many approaches promote cross-domain generalization by capturing domaininvariant features. However, these methods rely on unlabeled samples provided by the target domains, which renders the model ineffective when the target domain is agnostic. Furthermore, the models are easily disturbed by shortcut learning in the source domain, which also hinders the improvement of domain generalization ability. To solve the aforementioned issues, this paper proposes TACIT, a target domain agnostic feature disentanglement framework which adaptively decouples robust and unrobust features by Variational Auto-Encoders. Additionally, to encourage the separation of unrobust features from robust features, we design a feature distillation task that compels unrobust features to approximate the output of the teacher. The teacher model is trained with a few easy samples that are easy to carry potential unknown shortcuts. Experimental results verify that our framework achieves comparable results to state-of-the-art baselines while utilizing only source domain data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Learning Beyond Domains: Misleading Prompts and Pseudo-Label Contrast for Text Domain GeneralizationQizhi Li, Xuyang Wang, Yingke Chen, Ming Yan et al.AAAI 2026 · 1 citation
- Toward Robust In-Context Learning: Leveraging Out-of-distribution Proxies for Target Inaccessible Demonstration RetrievalHao Xu, Rite Bo, Fausto Giunchiglia, Yingji Li et al.ACL 2026
Builds on8
- Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
- Adversarial and Domain-Aware BERT for Cross-Domain Sentiment AnalysisChunning Du, Haifeng Sun, Jingyu Wang, Qi Qi et al.ACL 2020 · 165 citations
- Adversarial Soft Prompt Tuning for Cross-Domain Sentiment AnalysisHui Wu, Xiaodong ShiACL 2022 · 98 citations
- MASKER: Masked Keyword Regularization for Reliable Text ClassificationSeung Jun Moon, Sangwoo Mo, Kimin Lee, Jaeho Lee et al.AAAI 2021 · 39 citations
- Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-TrainingHai Ye, Qingyu Tan, Ruidan He, Juntao Li et al.EMNLP 2020 · 36 citations
Related papers
- Matching Distributions between Model and Data: Cross-domain Knowledge Distillation for Unsupervised Domain AdaptationBo Zhang, Xiaoming Zhang, Yun Liu, Lei Cheng et al.ACL 2021
- PromptKD: Unsupervised Prompt Distillation for Vision-Language ModelsZheng Li, Xiang Li, Xinyi Fu, Xin Zhang et al.CVPR 2024
- Dual Adversarial Co-Learning for Multi-Domain Text ClassificationYuan Wu, Yuhong GuoAAAI 2020 · 26 citations
- Reconstruction Target Matters in Masked Image Modeling for Cross-Domain Few-Shot LearningRan Ma, Yixiong Zou, Yuhua Li, Ruixuan LiAAAI 2025 · 2 citations
- Domain Generalization via Feature Variation DecorrelationChang Liu, Lichen Wang, Kai Li, Yun FuACM MM 2021 · 21 citations
