Disambiguate Words like Composing Them: A Morphology-Informed Approach to Enhance Chinese Word Sense Disambiguation
Yue Wang, Qiliang Liang, Yaqi Yin, Hansi Wang, Yang Liu
Abstract
In parataxis languages like Chinese, word meanings are highly correlated with morphological knowledge, which can help to disambiguate word senses. However, in-depth exploration of morphological knowledge in previous word sense disambiguation (WSD) methods is still lacking due to the absence of publicly available resources. In this paper, we are motivated to enhance Chinese WSD with full morphological knowledge, including both word-formations and morphemes. We first construct the largest releasable Chinese WSD resources, including the lexico-semantic inventories MorInv and WrdInv, a Chinese WSD dataset MiCLS, and an out-of-volcabulary (OOV) test set. Then, we propose a model, MorBERT, to fully leverage this morphology-informed knowledge for Chinese WSD and achieve a SOTA F1 of 92.18% on MiCLS dataset. Finally, we demonstrated the model's robustness in low-resource settings and generalizability to OOV senses. These resources and methods may bring new insights into and solutions for various downstream tasks in both computational and humanistic fields 1 .
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on8
- Revisiting Pre-Trained Models for Chinese Natural Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, Bing Qin et al.EMNLP Findings 2020 · 866 citations
- Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph InformationMichele Bevilacqua, Roberto NavigliACL 2020 · 145 citations
- ConSeC: Word Sense Disambiguation as Continuous Sense ComprehensionEdoardo Barba, Luigi Procopio, Roberto NavigliEMNLP 2021 · 60 citations
- Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encodersTerra Blevins, Luke ZettlemoyerACL 2020 · 19 citations
- Rare and Zero-shot Word Sense Disambiguation using Z-ReweightingYing Su, Hongming Zhang, Yangqiu Song, Tong ZhangACL 2022 · 12 citations
Related papers
- Leveraging Word-Formation Knowledge for Chinese Word Sense DisambiguationHua Zheng, Lei Li, Damai Dai, Deli Chen et al.EMNLP Findings 2021 · 8 citations
- SensEmBERT: Context-Enhanced Sense Embeddings for Multilingual Word Sense DisambiguationBianca Scarlini, Tommaso Pasini, Roberto NavigliAAAI 2020 · 121 citations
- Improving HowNet-Based Chinese Word Sense Disambiguation with TranslationsXiang Zhang, Bradley Hauer, Grzegorz KondrakEMNLP Findings 2022 · 10 citations
- CluBERT: A Cluster-Based Approach for Learning Sense Distributions in Multiple LanguagesTommaso Pasini, Federico Scozzafava, Bianca ScarliniACL 2020 · 23 citations
- Unsupervised Chinese Word Segmentation with BERT Oriented Probing and TransformationWei Li, Yuhan Song, Qi Su, Yanqiu ShaoACL Findings 2022 · 5 citations
