A Fine-Grained Domain Adaption Model for Joint Word Segmentation and POS Tagging
Peijie Jiang, Dingkun Long, Yueheng Sun, Meishan Zhang, Guangwei Xu, Pengjun Xie
Abstract
Domain adaption for word segmentation and POS tagging is a challenging problem for Chinese lexical processing. Self-training is one promising solution for it, which struggles to construct a set of high-quality pseudo training instances for the target domain. Previous work usually assumes a universal sourceto-target adaption to collect such pseudo corpus, ignoring the different gaps from the target sentences to the source domain. In this work, we start from joint word segmentation and POS tagging, presenting a fine-grained domain adaption method to model the gaps accurately. We measure the gaps by one simple and intuitive metric, and adopt it to develop a pseudo target domain corpus based on finegrained subdomains incrementally. A novel domain-mixed representation learning model is proposed accordingly to encode the multiple subdomains effectively. The whole process is performed progressively for both corpus construction and model training. Experimental results on a benchmark dataset show that our method can gain significant improvements over a vary of baselines. Extensive analyses are performed to show the advantages of our final domain adaption model as well.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e93fe465-3733-4cae-86ae-a431c73d671cCited by top-tier papers1
Ask how each one uses itBuilds on6
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Confidence Regularized Self-TrainingYang Zou, Zhiding Yu, Xiaofeng Liu, B. V. K. Vijaya Kumar et al.ICCV 2019 · 901 citations
- Universal Domain Adaptation through Self SupervisionKuniaki Saito, Donghyun Kim, Stan Sclaroff, Kate SaenkoNeurIPS 2020 · 401 citations
- Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-way Attentions of Auto-analyzed KnowledgeYuanhe Tian, Yan Song, Xiang Ao, Fei Xia et al.ACL 2020 · 50 citations
- Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word SegmentationNing Ding, Dingkun Long, Guangwei Xu, Muhua Zhu et al.ACL 2020 · 12 citations
Related papers
- Adversarial-Learned Loss for Domain AdaptationMinghao Chen, Shuai Zhao, Haifeng Liu, Deng CaiAAAI 2020 · 195 citations
- Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic SegmentationPan Zhang, Bo Zhang, Ting Zhang, Dong Chen et al.CVPR 2021
- Learning Pseudo-Relations for Cross-domain Semantic SegmentationDong Zhao, Shuang Wang, Qi Zang, Dou Quan et al.ICCV 2023 · 31 citations
- Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype LearningRan Zhou, Xin Li, Lidong Bing, Erik Cambria et al.ACL 2023 · 19 citations
- Category Dictionary Guided Unsupervised Domain Adaptation for Object DetectionShuai Li, Jianqiang Huang, Xian-Sheng Hua, Lei ZhangAAAI 2021 · 47 citations
