Lune

ACL Findings2025

Can Language Models Serve as Analogy Annotators?

Xiaojing Zhang, Bochen Lyu

Abstract

Conceptual abstraction and analogy-making are crucial for human learning, reasoning, and adapting to unfamiliar domains. Recently, large language models (LLMs) have made the synthesis of analogical data possible, which, however, still heavily relies on extensive human efforts to be annotated. This paper empirically examines the LLMs' capability to annotate story-level analogical data. Specifically, we propose a novel multi-stage progressive reasoning prompt framework A3E (Automated Analogy Annotation Expert), which is based on the structure mapping theory from cognitive psychology and efficiently annotates candidate story pairs across six fine-grained categories. We use A3E to evaluate how well the state-of-the-art LLMs can serve as analogy annotators. Experimental results demonstrate that our proposed A3E achieves an average performance gain of + 73% across a range of prompting baselines and base LLMs. The code and data can be available at https://github.com/zhangxjohn/A3E.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Large Language Models are Zero-Shot Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models as Analogical Reasoners cites Large Language Models are Zero-Shot Reasoners
  • Large Language Models as Analogical Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • StoryAnalogy: Deriving Story-level Analogies from Large Language Models to Unlock Analogical Understanding cites Scientific and Creative Analogies in Pretrained Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on6

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  3. Large Language Models as Analogical ReasonersMichihiro Yasunaga, Xinyun Chen, Yujia Li, Panupong Pasupat et al.ICLR 2024 · 155 citations
  4. Scientific and Creative Analogies in Pretrained Language ModelsTamara Czinczoll, Helen Yannakoudakis, Pushkar Mishra, Ekaterina ShutovaEMNLP Findings 2022 · 14 citations
  5. StoryAnalogy: Deriving Story-level Analogies from Large Language Models to Unlock Analogical UnderstandingCheng Jiayang, Lin Qiu, Tsz Ho Chan, Tianqing Fang et al.EMNLP 2023 · 8 citations

Related papers

  1. Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the TextKewei Cheng, Nesreen K. Ahmed, Theodore L. Willke, Yizhou SunEMNLP 2024 · 6 citations
  2. Inductive Linguistic Reasoning with Large Language ModelsRaghav Ramji, Keshav RamjiACL Findings 2025
  3. The Curious Case of Analogies: Investigating Analogical Reasoning in Large Language ModelsTaewhoo Lee, Minju Song, Chanwoong Yoon, Jungwoo Park et al.AAAI 2026 · 1 citation
  4. Unlocking Scientific Concepts: How Effective Are LLM-Generated Analogies for Student Understanding and Classroom Practice?Zekai Shao, Siyu Yuan, Lin Gao, Yixuan He et al.CHI 2025 · 12 citations
  5. Thought Propagation: an Analogical Approach to Complex Reasoning with Large Language ModelsJunchi Yu, Ran He, Zhitao YingICLR 2024 · 44 citations
Dusk over the sea between two cliffs drawn in fine vertical lines