Definition Modelling for Appropriate Specificity
Han Huang, Tomoyuki Kajiwara, Yuki Arase
Abstract
Definition generation techniques aim to generate a definition of a target word or phrase given a context. In previous studies, researchers have faced various issues such as the out-of-vocabulary problem and over/underspecificity problems. Over-specific definitions present narrow word meanings, whereas under-specific definitions present general and context-insensitive meanings. Herein, we propose a method for definition generation with appropriate specificity. The proposed method addresses the aforementioned problems by leveraging a pre-trained encoderdecoder model, namely Text-to-Text Transfer Transformer, and introducing a re-ranking mechanism to model specificity in definitions. 1 Experimental results on standard evaluation datasets indicate that our method significantly outperforms the previous state-of-theart method. Moreover, manual evaluation confirms that our method effectively addresses the over/under-specificity problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Leveraging Large Language Models for Learning Complex Legal Concepts through StorytellingHang Jiang, Xiajie Zhang, Robert Mahari, Daniel T. Kessler et al.ACL 2024 · 12 citations
- Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change AnalysisMario Giulianelli, Iris Luden, Raquel Fernández, Andrey KutuzovACL 2023 · 9 citations
- Using Synchronic Definitions and Semantic Relations to Classify Semantic Change TypesPierluigi Cassotti, Stefano De Pascale, Nina TahmasebiACL 2024 · 2 citations
- Automatically Generated Definitions and their utility for Modeling Word MeaningFrancesco Periti, David Alfter, Nina TahmasebiEMNLP 2024 · 2 citations
- Multitasking Framework for Unsupervised Simple Definition GenerationCunliang Kong, Yun Chen, Hengyuan Zhang, Liner Yang et al.ACL 2022
Builds on4
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Generationary or "How We Went beyond Word Sense Inventories and Learned to Gloss"Michele Bevilacqua, Marco Maru, Roberto NavigliEMNLP 2020 · 41 citations
- Explicit Semantic Decomposition for Definition GenerationJiahuan Li, Yu Bao, Shujian Huang, Xinyu Dai et al.ACL 2020 · 14 citations
- Automatic Machine Translation Evaluation in Many Languages via Zero-Shot ParaphrasingBrian Thompson, Matt PostEMNLP 2020 · 7 citations
Related papers
- VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition ModelingMachel Reid, Edison Marrese-Taylor, Yutaka MatsuoEMNLP 2020 · 14 citations
- Definition Generation for Word Meaning Modeling: Monolingual, Multilingual, and Cross-Lingual PerspectivesFrancesco Periti, Roksana Goworek, Haim Dubossarsky, Nina TahmasebiEMNLP 2025
- Prompt-Free Diffusion: Taking "Text" Out of Text-to-Image Diffusion ModelsXingqian Xu, Jiayi Guo, Zhangyang Wang, Gao Huang et al.CVPR 2024 · 45 citations
- LexFit: Lexical Fine-Tuning of Pretrained Language ModelsIvan Vulic, Edoardo Maria Ponti, Anna Korhonen, Goran GlavasACL 2021
- MT2: Towards a Multi-Task Machine Translation Model with Translation-Specific In-Context LearningChunyou Li, Mingtong Liu, Hongxiao Zhang, Yufeng Chen et al.EMNLP 2023 · 3 citations
