Data Augmentation for Cross-Domain Named Entity Recognition
Shuguang Chen, Gustavo Aguilar, Leonardo Neves, Thamar Solorio
Abstract
Current work in named entity recognition (NER) shows that data augmentation techniques can produce more robust models. However, most existing techniques focus on augmenting in-domain data in low-resource scenarios where annotated data is quite limited. In contrast, we study cross-domain data augmentation for the NER task. We investigate the possibility of leveraging data from highresource domains by projecting it into the lowresource domains. Specifically, we propose a novel neural architecture to transform the data representation from a high-resource to a low-resource domain by learning the patterns (e.g. style, noise, abbreviations, etc.) in the text that differentiate them and a shared feature space where both domains are aligned. We experiment with diverse datasets and show that transforming the data to the low-resource domain representation achieves significant improvements over only using data from highresource domains. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 138a58d1-1555-4ada-9fbe-e8194451ea84Cited by top-tier papers9
- PromptNER: Prompt Locating and Typing for Named Entity RecognitionYongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang et al.ACL 2023 · 46 citations
- Exploring Modular Task Decomposition in Cross-domain Named Entity RecognitionXinghua Zhang, Bowen Yu, Yubin Wang, Tingwen Liu et al.SIGIR 2022 · 18 citations
- AUC Maximization for Low-Resource Named Entity RecognitionNgoc Dang Nguyen, Wei Tan, Lan Du, Wray L. Buntine et al.AAAI 2023 · 12 citations
- Style Transfer as Data Augmentation: A Case Study on Named Entity RecognitionShuguang Chen, Leonardo Neves, Thamar SolorioEMNLP 2022 · 9 citations
- VerifiNER: Verification-augmented NER via Knowledge-grounded Reasoning with Large Language ModelsSeoyeon Kim, Kwangwook Seo, Hyungjoo Chae, Jinyoung Yeo et al.ACL 2024 · 7 citations
Builds on6
- DAGA: Data Augmentation with a Generation Approach forLow-resource Tagging TasksBosheng Ding, Linlin Liu, Lidong Bing, Canasai Kruengkrai et al.EMNLP 2020 · 132 citations
- Rethinking Generalization of Neural Models: A Named Entity Recognition Case StudyJinlan Fu, Pengfei Liu, Qi ZhangAAAI 2020 · 79 citations
- Educating Text Autoencoders: Latent Representation Guidance via DenoisingTianxiao Shen, Jonas Mueller, Regina Barzilay, Tommi S. JaakkolaICML 2020 · 74 citations
- SeqMix: Augmenting Active Sequence Labeling via Sequence MixupRongzhi Zhang, Yue Yu, Chao ZhangEMNLP 2020 · 65 citations
- Temporally-Informed Analysis of Named Entity RecognitionShruti Rijhwani, Daniel Preotiuc-PietroACL 2020 · 49 citations
Related papers
- MulDA: A Multilingual Data Augmentation Framework for Low-Resource Cross-Lingual NERLinlin Liu, Bosheng Ding, Lidong Bing, Shafiq R. Joty et al.ACL 2021
- PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity RecognitionTao Zhang, Congying Xia, Philip S. Yu, Zhiwei Liu et al.EMNLP 2021 · 22 citations
- MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NERRan Zhou, Xin Li, Ruidan He, Lidong Bing et al.ACL 2022 · 114 citations
- Robust and Informative Text Augmentation (RITA) via Constrained Worst-Case Transformations for Low-Resource Named Entity RecognitionHyunwoo Sohn, Baekkwan ParkKDD 2022 · 3 citations
- MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity RecognitionJinyuan Fang, Xiaobin Wang, Zaiqiao Meng, Pengjun Xie et al.ACL 2023 · 13 citations
