Lune

ACL Findings2021

Verb Sense Clustering using Contextualized Word Representations for Semantic Frame Induction

Kosuke Yamada, Ryohei Sasano, Koichi Takeda

Abstract

Contextualized word representations have proven useful for various natural language processing tasks. However, it remains unclear to what extent these representations can cover hand-coded semantic information such as semantic frames, which specify the semantic role of the arguments associated with a predicate. In this paper, we focus on verbs that evoke different frames depending on the context, and we investigate how well contextualized word representations can recognize the difference of frames that the same verb evokes. We also explore which types of representation are suitable for semantic frame induction. In our experiments, we compare seven different contextualized word representations for two English frame-semantic resources, FrameNet and PropBank. We demonstrate that several contextualized word representations, especially BERT and its variants, are considerably informative for semantic frame induction. Furthermore, we examine the extent to which the contextualized representation of a verb can estimate the number of frames that the verb can evoke.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. A Survey of Inductive Reasoning for Large Language ModelsKedi Chen, Dezhao Ruan, Yuhao Dan, Yaoting Wang et al.ACL 2026 · 5 citations

Builds on2

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
  2. Incorporating BERT into Neural Machine TranslationJinhua Zhu, Yingce Xia, Lijun Wu, Di He et al.ICLR 2020 · 391 citations

Related papers

  1. FrameEOL: Semantic Frame Induction using Causal Language ModelsChihiro Yano, Kosuke Yamada, Hayato Tsukagoshi, Ryohei Sasano et al.EMNLP Findings 2025
  2. Acquiring Frame Element Knowledge with Deep Metric Learning for Semantic Frame InductionKosuke Yamada, Ryohei Sasano, Koichi TakedaACL Findings 2023 · 1 citation
  3. Definition Generation for Automatically Induced Semantic FrameYi Han, Ryohei Sasano, Koichi TakedaACL Findings 2024
  4. A Graph-Based Neural Model for End-to-End Frame Semantic ParsingZhichao Lin, Yueheng Sun, Meishan ZhangEMNLP 2021 · 9 citations
  5. A Knowledge-Guided Framework for Frame IdentificationXuefeng Su, Ru Li, Xiaoli Li, Jeff Z. Pan et al.ACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines