A Simple Yet Effective Subsequence-Enhanced Approach for Cross-Domain NER
Jinpeng Hu, Dandan Guo, Yang Liu, Zhuo Li, Zhihong Chen, Xiang Wan, Tsung-Hui Chang
Abstract
Cross-domain named entity recognition (NER), aiming to address the limitation of labeled resources in the target domain, is a challenging yet important task. Most existing studies alleviate the data discrepancy across different domains at the coarse level via combing NER with language modelings or introducing domain-adaptive pre-training (DAPT). Notably, source and target domains tend to share more fine-grained local information within denser subsequences than global information within the whole sequence, such that subsequence features are easier to transfer, which has not been explored well. Besides, compared to token-level representation, subsequence-level information can help the model distinguish different meanings of the same word in different domains. In this paper, we propose to incorporate subsequence-level features for promoting the cross-domain NER. In detail, we first utilize a pre-trained encoder to extract the global information. Then, we re-express each sentence as a group of subsequences and propose a novel bidirectional memory recurrent unit (BMRU) to capture features from the subsequences. Finally, an adaptive coupling unit (ACU) is proposed to combine global information and subsequence features for predicting entity labels. Experimental results on several benchmark datasets illustrate the effectiveness of our model, which achieves considerable improvements.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Distribution Alignment Optimization through Neural Collapse for Long-tailed ClassificationJintong Gao, He Zhao, Dandan Guo, Hongyuan ZhaICML 2024 · 27 citations
- APLOT: Robust Reward Modeling via Adaptive Preference Learning with Optimal TransportZhuo Li, Yuege Feng, Dandan Guo, Jinpeng Hu et al.EMNLP 2025
- ALRMR-GEC: Adjusting Learning Rate Based on Memory Rate to Optimize the Edit Scorer for Grammatical Error CorrectionZhixiao Wu, Yao Lu, Jie Wen, Guangming LuAAAI 2025
- From Texts to Rules: Generating Sigma Rules with Large Language Models from Cyber Threat ReportsYongxin Cai, Jing Qiu, Qingming Li, Du Cheng et al.USENIX Security 2026
- Self-Instructed Derived Prompt Generation Meets In-Context Learning: Unlocking New Potential of Black-Box LLMsZhuo Li, Yuhao Du, Jinpeng Hu, Xiang Wan et al.ACL 2025
Builds on6
- LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionIkuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda et al.EMNLP 2020 · 562 citations
- CrossNER: Evaluating Cross-Domain Named Entity RecognitionZihan Liu, Yan Xu, Tiezheng Yu, Wenliang Dai et al.AAAI 2021 · 201 citations
- Hierarchical Contextualized Representation for Named Entity RecognitionYing Luo, Fengshun Xiao, Hai ZhaoAAAI 2020 · 138 citations
- Don't Stop Pretraining: Adapt Language Models to Domains and TasksSuchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo et al.ACL 2020 · 93 citations
- Multi-Cell Compositional LSTM for NER Domain AdaptationChen Jia, Yue ZhangACL 2020 · 62 citations
Related papers
- Three Heads Are Better than One: Improving Cross-Domain NER with Progressive Decomposed NetworkXuming Hu, Zhaochen Hong, Yong Jiang, Zhichao Lin et al.AAAI 2024 · 1 citation
- Exploring Modular Task Decomposition in Cross-domain Named Entity RecognitionXinghua Zhang, Bowen Yu, Yubin Wang, Tingwen Liu et al.SIGIR 2022 · 18 citations
- Domain-Adapted Dependency Parsing for Cross-Domain Named Entity RecognitionChenxiao Dou, Xianghui Sun, Yaoshu Wang, Yunjie Ji et al.AAAI 2023 · 8 citations
- PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity RecognitionTao Zhang, Congying Xia, Philip S. Yu, Zhiwei Liu et al.EMNLP 2021 · 22 citations
- Representation and Labeling Gap Bridging for Cross-lingual Named Entity RecognitionXinghua Zhang, Bowen Yu, Jiangxia Cao, Quangang Li et al.SIGIR 2023 · 5 citations
