MCL: Multi-Granularity Contrastive Learning Framework for Chinese NER
Shan Zhao, Chengyu Wang, Minghao Hu, Tianwei Yan, Meng Wang
摘要
Recently, researchers have applied the word-character lattice framework to integrated word information, which has become very popular for Chinese named entity recognition (NER). However, prior approaches fuse word information by different variants of encoders such as Lattice LSTM or Flat-Lattice Transformer, but are still not data-efficient indeed to fully grasp the depth interaction of cross-granularity and important word information from the lexicon. In this paper, we go beyond the typical lattice structure and propose a novel Multi-Granularity Contrastive Learning framework (MCL), that aims to optimize the inter-granularity distribution distance and emphasize the critical matched words in the lexicon. By carefully combining cross-granularity contrastive learning and bi-granularity contrastive learning, the network can explicitly leverage lexicon information on the initial lattice structure, and further provide more dense interactions of across-granularity, thus significantly improving model performance. Experiments on four Chinese NER datasets show that MCL obtains state-of-the-art results while considering model efficiency. The source code of the proposed method is publicly available at https://github.com/zs50910/MCL
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- SENCR: A Span Enhanced Two-Stage Network with Counterfactual Rethinking for Chinese NERHang Zheng, Qingsong Li, Shen Chen, Yuxuan Liang 等AAAI 2024 · 被引用 8 次
- A Dual-Way Enhanced Framework from Text Matching Point of View for Multimodal Entity LinkingShezheng Song, Shan Zhao, Chengyu Wang, Tianwei Yan 等AAAI 2024
它引用的顶会 Paper15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 被引用 2,496 次
- Unified Named Entity Recognition as Word-Word Relation ClassificationJingye Li, Hao Fei, Jiang Liu, Shengqiong Wu 等AAAI 2022 · 被引用 340 次
- Simplify the Usage of Lexicon in Chinese NERRuotian Ma, Minlong Peng, Qi Zhang, Zhongyu Wei 等ACL 2020 · 被引用 286 次
- Graph Enhanced Contrastive Learning for Radiology Findings SummarizationJinpeng Hu, Zhuo Li, Zhihong Chen, Zhen Li 等ACL 2022 · 被引用 40 次
相关 Paper
- Dynamic Modeling Cross- and Self-Lattice Attention Network for Chinese NERShan Zhao, Minghao Hu, Zhiping Cai, Haiwen Chen 等AAAI 2021 · 被引用 30 次
- MCL-NER: Cross-Lingual Named Entity Recognition via Multi-View Contrastive LearningYing Mo, Jian Yang, Jiahao Liu, Qifan Wang 等AAAI 2024 · 被引用 42 次
- MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity RecognitionShuang Wu, Xiaoning Song, Zhen-Hua FengACL 2021
- Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource LanguagesXu Han, Yuqi Luo, Weize Chen, Zhiyuan Liu 等ACL 2022
- Optimizing Bi-Encoder for Named Entity Recognition via Contrastive LearningSheng Zhang, Hao Cheng, Jianfeng Gao, Hoifung PoonICLR 2023 · 被引用 22 次
