ACL Findings2024
A Semantic Distance Metric Learning approach for Lexical Semantic Change Detection
Abstract
Detecting temporal semantic changes of words is an important task for various NLP applications that must make time-sensitive predictions. Lexical semantic change detection (SCD) task involves predicting whether a given target word, w, changes its meaning between two different text corpora, C 1 and C 2 . For this purpose, we propose a supervised two-staged SCD method that uses existing Word-in-Context (WiC) datasets. In the first stage, for a target word w, we learn two sense-aware encoders that represent the meaning of w in a given sentence selected from a corpus. Next, in the second stage, we learn a sense-aware distance metric that compares the semantic representations of a target word across all of its occurrences in C 1 and C 2 . Experimental results on multiple benchmark datasets for SCD show that our proposed method achieves strong performance in multiple languages. Additionally, our method achieves significant improvements on WiC benchmarks compared to a sense-aware encoder with conventional distance functions. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change cites Mind the Gap: Assessing Temporal Generalization in Neural Language Models
- Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddings cites Mind the Gap: Assessing Temporal Generalization in Neural Language Models
- Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddings cites Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change
Cited by top-tier papers1
Builds on10
- Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
- Mind the Gap: Assessing Temporal Generalization in Neural Language ModelsAngeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal et al.NeurIPS 2021 · 315 citations
- An Information-theoretic Approach to Prompt Engineering Without Ground Truth LabelsTaylor Sorensen, Joshua Robinson, Christopher Michael Rytting, Alexander Glenn Shaw et al.ACL 2022 · 142 citations
- Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic ChangeZhaochen Su, Zecheng Tang, Xinyan Guan, Lijun Wu et al.EMNLP 2022 · 11 citations
- Unsupervised Semantic Variation Prediction using the Distribution of Sibling EmbeddingsTaichi Aida, Danushka BollegalaACL Findings 2023 · 4 citations
Related papers
- Swap and Predict - Predicting the Semantic Changes in Words across Corpora by Context SwappingTaichi Aida, Danushka BollegalaEMNLP Findings 2023 · 2 citations
- A Word Sense Distribution-based approach for Semantic Change PredictionXiaohang Tang, Yi Zhou, Taichi Aida, Procheta Sen et al.EMNLP Findings 2023 · 2 citations
- Fake it Till You Make it: Self-Supervised Semantic Shifts for Monolingual Word Embedding TasksMaurício Gruppi, Pin-Yu Chen, Sibel AdaliAAAI 2021 · 7 citations
- Sequential Modelling of the Evolution of Word Representations for Semantic Change DetectionAdam Tsakalidis, Maria LiakataEMNLP 2020 · 14 citations
- Definition generation for lexical semantic change detectionMariia Fedorova, Andrey Kutuzov, Yves ScherrerACL Findings 2024 · 2 citations
