Lune

ACL Findings2023

Chain of Thought Prompting Elicits Knowledge Augmentation

Dingjun Wu, Jing Zhang, Xinmei Huang

Abstract

The knowledge-augmented deep learning paradigm refers to a paradigm in which domain knowledge is identified and integrated into deep models. Conventional methods typically employ task-specific approaches to gather external knowledge from various sources. In contrast, large language models are extensively pre-trained and can serve as a comprehensive source of external knowledge. In this paper, we propose CoT-KA, a Chain-of-Thought-based method that augments knowledge for deep learning. CoT-KA avoids the need for additional knowledge retrieval or knowledge reasoning models, as required in conventional augmentation methods. Our results demonstrate that CoT-KA outperforms both pure CoT-based methods and the non-augmented method across the majority of eleven publicly available benchmarks for various reasoning tasks 1 .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

8 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Large Language Models are Zero-Shot Reasoners
  • Large Language Models are Zero-Shot Reasoners cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Language Models are Few-Shot Learners
  • Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Chain-of-Thought Prompting Elicits Reasoning in Large Language Models cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Chain-of-Thought Improves Text Generation with Citations in Large Language Models cites Large Language Models are Zero-Shot Reasoners
  • Chain-of-Thought Improves Text Generation with Citations in Large Language Models cites Language Models are Few-Shot Learners
  • Chain-of-Thought Improves Text Generation with Citations in Large Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models are Zero-Shot Reasoners cites Language Models are Few-Shot Learners
  • Large Language Models are Zero-Shot Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • CDW-CoT: Clustered Distance-Weighted Chain-of-Thoughts Reasoning cites Large Language Models are Zero-Shot Reasoners
  • CDW-CoT: Clustered Distance-Weighted Chain-of-Thoughts Reasoning cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models Are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales cites Large Language Models are Zero-Shot Reasoners
  • Large Language Models Are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers8

  1. Iterative Reasoning Preference OptimizationRichard Yuanzhe Pang, Weizhe Yuan, He He, Kyunghyun Cho et al.NeurIPS 2024 · 287 citations
  2. Large Language Models Are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated RationalesTaeyoon Kwon, Kai Tzu-iunn Ong, Dongjin Kang, Seungjun Moon et al.AAAI 2024 · 71 citations
  3. Chain-of-Thought Improves Text Generation with Citations in Large Language ModelsBin Ji, Huijun Liu, Mingzhe Du, See-Kiong NgAAAI 2024 · 17 citations
  4. SeGA: Preference-Aware Self-Contrastive Learning with Prompts for Anomalous User Detection on TwitterYing-Ying Chang, Wei-Yao Wang, Wen-Chih PengAAAI 2024 · 11 citations
  5. CDW-CoT: Clustered Distance-Weighted Chain-of-Thoughts ReasoningYuanheng Fang, Guoqing Chao, Wenqiang Lei, Shaobo Li et al.AAAI 2025 · 4 citations

Builds on10

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  3. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  4. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
  5. Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations

Related papers

  1. KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts ReasoningDebjyoti Mondal, Suraj Modi, Subhadarshi Panda, Rituraj Singh et al.AAAI 2024 · 96 citations
  2. Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex QuestionsShulin Cao, Jiajie Zhang, Jiaxin Shi, Xin Lv et al.EMNLP Findings 2023 · 17 citations
  3. Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled DataKashun Shum, Shizhe Diao, Tong ZhangEMNLP Findings 2023 · 63 citations
  4. CoT-RAG: Integrating Chain of Thought and Retrieval-Augmented Generation to Enhance Reasoning in Large Language ModelsFeiyang Li, Peng Fang, Zhan Shi, Arijit Khan et al.EMNLP Findings 2025 · 11 citations
  5. CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question AnsweringYike Wu, Yi Huang, Nan Hu, Yuncheng Hua et al.EMNLP 2024 · 9 citations
Dusk over the sea between two cliffs drawn in fine vertical lines