EMNLP Findings2025
Explaining novel senses using definition generation with open language models
Mariia Fedorova, Andrey Kutuzov, Francesco Periti, Yves Scherrer
Abstract
We apply definition generators based on openweights Large Language Models (LLMs) to the task of explaining novel word senses, taking target word usages as an input. To this end, we employ the datasets from the AX-OLOTL'24 shared task on explainable semantic change modeling, which features Finnish, Russian and German languages. We fine-tune and provide publicly open-source models performing higher than the best submissions of the aforementioned shared task, which employed closed proprietary LLMs. In addition, we find that encoder-decoder definition generators perform on par with their decoder-only counterparts.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers1
Builds on9
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 5,863 citations
- Neural Text Generation With Unlikelihood TrainingSean Welleck, Ilia Kulikov, Stephen Roller, Emily Dinan et al.ICLR 2020 · 683 citations
- Crosslingual Generalization through Multitask FinetuningNiklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts et al.ACL 2023 · 319 citations
- Making Monolingual Sentence Embeddings Multilingual using Knowledge DistillationNils Reimers, Iryna GurevychEMNLP 2020 · 54 citations
Related papers
- Definition generation for lexical semantic change detectionMariia Fedorova, Andrey Kutuzov, Yves ScherrerACL Findings 2024 · 2 citations
- Automatically Generated Definitions and their utility for Modeling Word MeaningFrancesco Periti, David Alfter, Nina TahmasebiEMNLP 2024 · 2 citations
- Definition Generation for Word Meaning Modeling: Monolingual, Multilingual, and Cross-Lingual PerspectivesFrancesco Periti, Roksana Goworek, Haim Dubossarsky, Nina TahmasebiEMNLP 2025
- Analyzing Semantic Change through Lexical ReplacementsFrancesco Periti, Pierluigi Cassotti, Haim Dubossarsky, Nina TahmasebiACL 2024
- Do Large Language Models Understand Word Senses?Domenico Meconi, Simone Stirpe, Federico Martelli, Leonardo Lavalle et al.EMNLP 2025 · 7 citations
