Lune

EMNLP Findings2024

Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective

Taelin Karidi, Eitan Grossman, Omri Abend

Abstract

NLP research on aligning lexical representation spaces to one another has so far focused on aligning language spaces in their entirety. However, cognitive science has long focused on a local perspective, investigating whether translation equivalents truly share the same meaning or the extent that cultural and regional influences result in meaning variations. With recent technological advances and the increasing amounts of available data, the longstanding question of cross-lingual lexical alignment can now be approached in a more data-driven manner. However, developing metrics for the task requires some methodology for comparing metric efficacy. We address this gap and present a methodology for analyzing both synthetic validations and a novel naturalistic validation using lexical gaps in the kinship domain. We further propose new metrics, hitherto unexplored on this task, based on contextualized embeddings. Our analysis spans 16 diverse languages, demonstrating that there is substantial room for improvement with the use of newer language models. Our research paves the way for more accurate and nuanced cross-lingual lexical alignment methodologies and evaluation.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Probing Pretrained Language Models for Lexical Semantics cites On the Cross-lingual Transferability of Monolingual Representations
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on7

  1. CultureLLM: Incorporating Cultural Differences into Large Language ModelsCheng Li, Mengzhuo Chen, Jindong Wang, Sunayana Sitaram et al.NeurIPS 2024 · 101 citations
  2. On the Cross-lingual Transferability of Monolingual RepresentationsMikel Artetxe, Sebastian Ruder, Dani YogatamaACL 2020 · 57 citations
  3. Probing Pretrained Language Models for Lexical SemanticsIvan Vulic, Edoardo Maria Ponti, Robert Litschko, Goran Glavas et al.EMNLP 2020 · 26 citations
  4. Words are all you need? Language as an approximation for human similarity judgmentsRaja Marjieh, Pol van Rijn, Ilia Sucholutsky, Theodore R. Sumers et al.ICLR 2023 · 8 citations
  5. Fine-Grained Analysis of Cross-Linguistic Syntactic DivergencesDmitry Nikolaev, Ofir Arviv, Taelin Karidi, Neta Kenneth et al.ACL 2020 · 1 citation

Related papers

  1. Translation-based Lexicalization Generation and Lexical Gap Detection: Application to Kinship TermsSenyu Li, Bradley Hauer, Ning Shi, Grzegorz KondrakACL 2024 · 1 citation
  2. Predicting Human Translation Difficulty Using Automatic Word AlignmentZheng Wei Lim, Trevor Cohn, Charles Kemp, Ekaterina VylomovaACL Findings 2023 · 3 citations
  3. Normalization of Language Embeddings for Cross-Lingual AlignmentPrince Osei Aboagye, Yan Zheng, Chin-Chia Michael Yeh, Junpeng Wang et al.ICLR 2022 · 12 citations
  4. From Neurons to Semantics: Evaluating Cross-Linguistic Alignment Capabilities of Large Language Models via Neurons AlignmentChongxuan Huang, Yongshi Ye, Biao Fu, Qifeng Su et al.ACL 2025
  5. Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual GeneralizationNingyu Xu, Qi Zhang, Jingting Ye, Menghan Zhang et al.EMNLP Findings 2023 · 3 citations
Dusk over the sea between two cliffs drawn in fine vertical lines