Lune

EMNLP Findings2024

Merely Judging Metaphor is Not Enough: Research on Reasonable Metaphor Detection

Puli Chen, Cheng Yang, Qingbao Huang

Abstract

Metaphor, as an advanced form of cognition, is challenging to understand their meaning. Current metaphor detection tasks only provide labels (i.e., metaphor or literal) without interpreting how to understand them. In this paper, we improve the metaphor detection task and explore the reason of metaphor. To the best of our knowledge, we are the first work to reason about metaphor using mainstream Large Language Models (LLMs). Specifically, we utilized ChatGPT3.5 to expand the mainstream datasets in current metaphor detection, including VUA ALL, TroFi, and MOH-X. We input the original sentence, target word, and usage (metaphor or literal) into ChatGPT, guiding it to generate corresponding metaphor reason. Then, we designed supervised baseline experiments (e.g., RoBERTa, GPT-2) and zeroshot experiments with LLMs (e.g., LLaMA3). For the results generated by the above experiments, we provided the case study. We devised four methods that include manual evaluation to evaluate the reason performance of the model, and discussed extensively the advantages and disadvantages of these evaluation methods. Our code is available at https://github.com/yc- cy/Metaphorical-Reasoning.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • ZeroGen: Efficient Zero-shot Learning via Dataset Generation cites Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
  • Generating Training Data with Language Models: Towards Zero-Shot Language Understanding cites ZeroGen: Efficient Zero-shot Learning via Dataset Generation
  • Generating Training Data with Language Models: Towards Zero-Shot Language Understanding cites Deberta: decoding-Enhanced Bert with Disentangled Attention
  • Generating Training Data with Language Models: Towards Zero-Shot Language Understanding cites GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
  • Want To Reduce Labeling Cost? GPT-3 Can Help cites GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Metaphor Reasoning is Meta-reasoningQianyu He, Junting Lu, Yikai Zhang, Siyu Yuan et al.ACL 2026

Builds on11

  1. Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
  2. Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingYu Meng, Jiaxin Huang, Yu Zhang, Jiawei HanNeurIPS 2022 · 309 citations
  3. Want To Reduce Labeling Cost? GPT-3 Can HelpShuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu et al.EMNLP Findings 2021 · 177 citations
  4. GPT3Mix: Leveraging Large-scale Language Models for Text AugmentationKang Min Yoo, Dongju Park, Jaewook Kang, Sang-Woo Lee et al.EMNLP Findings 2021 · 151 citations
  5. ZeroGen: Efficient Zero-shot Learning via Dataset GenerationJiacheng Ye, Jiahui Gao, Qintong Li, Hang Xu et al.EMNLP 2022 · 96 citations

Related papers

  1. Can ChatGPT's Performance be Improved on Verb Metaphor Detection Tasks? Bootstrapping and Combining Tacit KnowledgeCheng Yang, Puli Chen, Qingbao HuangACL 2024
  2. Metaphor Understanding Challenge Dataset for LLMsXiaoyu Tong, Rochelle Choenni, Martha Lewis, Ekaterina ShutovaACL 2024
  3. M3UCD: A Multi-task Multimodal Metaphor Understanding Challenge Dataset for LLMsTianlong Zheng, Yating Yang, Rui Dong, Bo Ma et al.AAAI 2026
  4. Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and LanguagesEhsan Aghazadeh, Mohsen Fayyaz, Yadollah YaghoobzadehACL 2022
  5. Verb Metaphor Detection via Contextual Relation LearningWei Song, Shuhui Zhou, Ruiji Fu, Ting Liu et al.ACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines