Lune

ACL Findings2022

Probing Multilingual Cognate Prediction Models

Clémentine Fourrier, Benoît Sagot

Abstract

Character-based neural machine translation models have become the reference models for cognate prediction, a historical linguistics task. So far, all linguistic interpretations about latent information captured by such models have been based on external analysis (accuracy, raw results, errors). In this paper, we investigate what probing can tell us about both models and previous interpretations, and learn that though our models store linguistic and diachronic information, they do not achieve it in previously assumed ways.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. RoBoCoP: A Comprehensive ROmance BOrrowing COgnate Package and Benchmark for Multilingual Cognate IdentificationLiviu P. Dinu, Ana Sabina Uban, Alina Maria Cristea, Anca P. Dinu et al.EMNLP 2023 · 2 citations
  2. Semisupervised Neural Proto-Language ReconstructionLiang Lu, Peirong Xie, David R. MortensenACL 2024 · 1 citation

Builds on1

  1. Can Cognate Prediction Be Modelled as a Low-Resource Machine Translation Task?Clémentine Fourrier, Rachel Bawden, Benoît SagotACL Findings 2021 · 11 citations

Related papers

  1. Mechanisms vs. Outcomes: Probing for Syntax Fails to Explain Performance on Targeted Syntactic EvaluationsAnanth Agarwal, Jasper Jian, Christopher D. Manning, Shikhar MurtyEMNLP 2025 · 5 citations
  2. Information-Theoretic Probing for Linguistic StructureTiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, Ran Zmigrod et al.ACL 2020 · 21 citations
  3. A Latent-Variable Model for Intrinsic ProbingKarolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell et al.AAAI 2023 · 6 citations
  4. Inspecting the concept knowledge graph encoded by modern language modelsCarlos Aspillaga, Marcelo Mendoza, Alvaro SotoACL Findings 2021 · 7 citations
  5. Spying on Your Neighbors: Fine-grained Probing of Contextual Embeddings for Information about Surrounding WordsJosef Klafka, Allyson EttingerACL 2020 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines