MCL: Multi-Granularity Contrastive Learning Framework for Chinese NER
Shan Zhao, Chengyu Wang, Minghao Hu, Tianwei Yan, Meng Wang
Abstract
Recently, researchers have applied the word-character lattice framework to integrated word information, which has become very popular for Chinese named entity recognition (NER). However, prior approaches fuse word information by different variants of encoders such as Lattice LSTM or Flat-Lattice Transformer, but are still not data-efficient indeed to fully grasp the depth interaction of cross-granularity and important word information from the lexicon. In this paper, we go beyond the typical lattice structure and propose a novel Multi-Granularity Contrastive Learning framework (MCL), that aims to optimize the inter-granularity distribution distance and emphasize the critical matched words in the lexicon. By carefully combining cross-granularity contrastive learning and bi-granularity contrastive learning, the network can explicitly leverage lexicon information on the initial lattice structure, and further provide more dense interactions of across-granularity, thus significantly improving model performance. Experiments on four Chinese NER datasets show that MCL obtains state-of-the-art results while considering model efficiency. The source code of the proposed method is publicly available at https://github.com/zs50910/MCL
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- SENCR: A Span Enhanced Two-Stage Network with Counterfactual Rethinking for Chinese NERHang Zheng, Qingsong Li, Shen Chen, Yuxuan Liang et al.AAAI 2024 · 8 citations
- A Dual-Way Enhanced Framework from Text Matching Point of View for Multimodal Entity LinkingShezheng Song, Shan Zhao, Chengyu Wang, Tianwei Yan et al.AAAI 2024
Builds on15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Unified Named Entity Recognition as Word-Word Relation ClassificationJingye Li, Hao Fei, Jiang Liu, Shengqiong Wu et al.AAAI 2022 · 340 citations
- Simplify the Usage of Lexicon in Chinese NERRuotian Ma, Minlong Peng, Qi Zhang, Zhongyu Wei et al.ACL 2020 · 286 citations
- Graph Enhanced Contrastive Learning for Radiology Findings SummarizationJinpeng Hu, Zhuo Li, Zhihong Chen, Zhen Li et al.ACL 2022 · 40 citations
Related papers
- Dynamic Modeling Cross- and Self-Lattice Attention Network for Chinese NERShan Zhao, Minghao Hu, Zhiping Cai, Haiwen Chen et al.AAAI 2021 · 30 citations
- MCL-NER: Cross-Lingual Named Entity Recognition via Multi-View Contrastive LearningYing Mo, Jian Yang, Jiahao Liu, Qifan Wang et al.AAAI 2024 · 42 citations
- MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity RecognitionShuang Wu, Xiaoning Song, Zhen-Hua FengACL 2021
- Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource LanguagesXu Han, Yuqi Luo, Weize Chen, Zhiyuan Liu et al.ACL 2022
- Optimizing Bi-Encoder for Named Entity Recognition via Contrastive LearningSheng Zhang, Hao Cheng, Jianfeng Gao, Hoifung PoonICLR 2023 · 22 citations
