EMNLP Findings2024
Merely Judging Metaphor is Not Enough: Research on Reasonable Metaphor Detection
Puli Chen, Cheng Yang, Qingbao Huang
Abstract
Metaphor, as an advanced form of cognition, is challenging to understand their meaning. Current metaphor detection tasks only provide labels (i.e., metaphor or literal) without interpreting how to understand them. In this paper, we improve the metaphor detection task and explore the reason of metaphor. To the best of our knowledge, we are the first work to reason about metaphor using mainstream Large Language Models (LLMs). Specifically, we utilized ChatGPT3.5 to expand the mainstream datasets in current metaphor detection, including VUA ALL, TroFi, and MOH-X. We input the original sentence, target word, and usage (metaphor or literal) into ChatGPT, guiding it to generate corresponding metaphor reason. Then, we designed supervised baseline experiments (e.g., RoBERTa, GPT-2) and zeroshot experiments with LLMs (e.g., LLaMA3). For the results generated by the above experiments, we provided the case study. We devised four methods that include manual evaluation to evaluate the reason performance of the model, and discussed extensively the advantages and disadvantages of these evaluation methods. Our code is available at https://github.com/yc- cy/Metaphorical-Reasoning.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- ZeroGen: Efficient Zero-shot Learning via Dataset Generation cites Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
- Generating Training Data with Language Models: Towards Zero-Shot Language Understanding cites ZeroGen: Efficient Zero-shot Learning via Dataset Generation
- Generating Training Data with Language Models: Towards Zero-Shot Language Understanding cites Deberta: decoding-Enhanced Bert with Disentangled Attention
- Generating Training Data with Language Models: Towards Zero-Shot Language Understanding cites GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
- Want To Reduce Labeling Cost? GPT-3 Can Help cites GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
Cited by top-tier papers1
Builds on11
- Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
- Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingYu Meng, Jiaxin Huang, Yu Zhang, Jiawei HanNeurIPS 2022 · 309 citations
- Want To Reduce Labeling Cost? GPT-3 Can HelpShuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu et al.EMNLP Findings 2021 · 177 citations
- GPT3Mix: Leveraging Large-scale Language Models for Text AugmentationKang Min Yoo, Dongju Park, Jaewook Kang, Sang-Woo Lee et al.EMNLP Findings 2021 · 151 citations
- ZeroGen: Efficient Zero-shot Learning via Dataset GenerationJiacheng Ye, Jiahui Gao, Qintong Li, Hang Xu et al.EMNLP 2022 · 96 citations
Related papers
- Can ChatGPT's Performance be Improved on Verb Metaphor Detection Tasks? Bootstrapping and Combining Tacit KnowledgeCheng Yang, Puli Chen, Qingbao HuangACL 2024
- Metaphor Understanding Challenge Dataset for LLMsXiaoyu Tong, Rochelle Choenni, Martha Lewis, Ekaterina ShutovaACL 2024
- M3UCD: A Multi-task Multimodal Metaphor Understanding Challenge Dataset for LLMsTianlong Zheng, Yating Yang, Rui Dong, Bo Ma et al.AAAI 2026
- Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and LanguagesEhsan Aghazadeh, Mohsen Fayyaz, Yadollah YaghoobzadehACL 2022
- Verb Metaphor Detection via Contextual Relation LearningWei Song, Shuhui Zhou, Ruiji Fu, Ting Liu et al.ACL 2021
